-- Logs begin at Fri 2022-06-17 12:03:57 UTC, end at Fri 2022-06-17 13:37:26 UTC. -- Jun 17 12:42:57.357715 dv-cinder-846172-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 12:42:57.367462 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 12:42:57 2022] *** Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: nodename: dv-cinder-846172-2-iscsi Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: machine: x86_64 Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: clock source: unix Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: pcre jit disabled Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: detected number of CPU cores: 4 Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: current working directory: / Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: detected binary path: /usr/bin/uwsgi-core Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: your processes number limit is 47680 Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: your memory page size is 4096 bytes Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: detected max file descriptor number: 2048 Jun 17 12:42:57.369181 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: lock engine: pthread robust mutexes Jun 17 12:42:57.370063 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: thunder lock: enabled Jun 17 12:42:57.370063 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 12:42:57.370063 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 12:42:57.413108 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: Python main interpreter initialized at 0x55bbb41109c0 Jun 17 12:42:57.413108 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: python threads support enabled Jun 17 12:42:57.413108 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: your server socket listen backlog is limited to 100 connections Jun 17 12:42:57.413108 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: your mercy for graceful operations on workers is 90 seconds Jun 17 12:42:57.413468 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 12:42:57.413468 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: *** Operational MODE: preforking *** Jun 17 12:42:57.413758 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: *** uWSGI is running in multiple interpreter mode *** Jun 17 12:42:57.413758 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: spawned uWSGI master process (pid: 120002) Jun 17 12:42:57.413949 dv-cinder-846172-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 12:42:57.415474 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: spawned uWSGI worker 1 (pid: 120003, cores: 1) Jun 17 12:42:57.415474 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: spawned uWSGI worker 2 (pid: 120004, cores: 1) Jun 17 12:42:57.415474 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 12:42:58.065110 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:42:58.069847 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:42:59.232575 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:59.232575 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: from cryptography.utils import int_from_bytes Jun 17 12:42:59.233325 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:59.233325 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: from cryptography.utils import int_from_bytes Jun 17 12:42:59.233325 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:59.233325 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: from cryptography.utils import int_from_bytes Jun 17 12:42:59.233794 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:59.233794 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: from cryptography.utils import int_from_bytes Jun 17 12:43:01.850450 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:43:01.851179 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:43:01.851179 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:43:01.851608 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:43:01.851863 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:43:01.852312 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.852695 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.853015 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.853334 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.853664 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.854018 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.854484 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.854849 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.855216 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.855546 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.855862 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.856186 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-2-iscsi {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.856508 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.856813 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.857123 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.857442 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.857743 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.858053 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.858360 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.858872 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.859324 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.859655 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.859966 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.860302 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.860650 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.860958 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.861277 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.861593 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.861969 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.862324 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.862748 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-2-iscsi {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.863068 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.863418 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.863841 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.864383 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.864765 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.865085 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.865404 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.865725 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.866032 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.866356 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.866671 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.866988 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.867306 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.867633 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.867939 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.868251 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.868568 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.868871 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.869173 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.869420 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.869726 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.870044 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.870366 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.870688 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.870935 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.871181 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.871518 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.871830 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.872143 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.872452 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.872754 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.873057 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.873360 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.873662 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.873963 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.874265 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.874578 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.874891 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.875207 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.875531 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.875847 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.876383 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.876626 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.876966 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.877308 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.877622 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.877927 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.878207 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.878526 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.878832 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.879135 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.879464 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.879781 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.880112 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.880419 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.880667 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.880965 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.881266 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.881578 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.881878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.882179 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.882483 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.882779 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.883080 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.883389 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.883699 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.883999 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.884297 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.884594 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.884895 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.885193 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.885490 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.885804 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.886117 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.886415 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.886714 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.887011 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.887309 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.887648 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.887950 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.888249 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.888564 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.888862 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.889160 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.889471 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.889771 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.890072 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.890382 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.890679 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.890975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.891286 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.891641 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.891950 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.892248 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.892547 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.892845 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.893143 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.893439 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.893737 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.894033 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.894345 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.894659 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.894965 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.895269 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.895593 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.895908 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:01.896245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.896574 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.896912 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.897223 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.897551 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.897879 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.898193 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.898503 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.898814 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.899134 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.899464 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.899774 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.900081 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.900396 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.900713 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.901035 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.901345 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.901664 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.901976 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.902284 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.902599 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.902922 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.903241 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.903572 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.903909 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.904248 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.904559 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.904877 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.905214 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.905508 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.905817 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.906120 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.906435 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.906765 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.907073 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.907487 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.907805 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.908113 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.908411 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.908716 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.909025 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.909357 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.909669 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.909979 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.910287 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.910599 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.910906 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.911217 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.911552 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.911855 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.912159 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.912457 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.912762 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.913063 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.913380 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.913736 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.914040 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.914370 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.914671 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.914976 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.915280 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.915610 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.915912 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.916219 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.916526 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.916827 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.917144 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.917452 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.917791 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.918116 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.918419 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.918721 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.919034 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.919340 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.919671 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.919978 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.920283 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.920598 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.920915 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.921226 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.921558 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.921885 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.922190 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.922510 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.922844 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.923200 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.923501 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.923834 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.924134 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.924433 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.924736 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.925039 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.925308 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.925641 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.925942 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.926242 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.926543 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.926842 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.927144 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.927463 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.927752 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.928053 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.928391 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.928693 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.929032 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.929364 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.929680 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.930000 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.930308 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.930988 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.931298 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.931632 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.931945 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.932255 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.932571 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.932880 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.933199 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.933509 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.933827 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.934136 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.934452 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.934755 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.935069 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.935419 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.935773 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.936084 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.936402 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.936711 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.937016 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.937330 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.937634 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.937946 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.938253 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.938660 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.938981 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.939297 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.939623 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.939945 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.940252 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.940569 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.940871 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.941194 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.941503 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.941817 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.942123 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.942432 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.942751 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.943060 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.943364 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.943691 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.943993 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.944297 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.944604 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.944914 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.945220 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.945526 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.945826 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.946136 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.946439 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.946741 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.947041 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.947349 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.947687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.947996 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.948312 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.948626 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.948927 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.949229 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.949546 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.949858 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.950159 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.950460 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.950762 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.951098 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.951426 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.951730 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.952043 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.952360 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.952667 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.952981 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.953286 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.953591 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.953908 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.954351 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.954774 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.955167 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.955505 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.955821 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.956135 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.956457 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.956767 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.957080 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.957391 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.957697 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.958006 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.958324 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.958904 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.959234 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.959577 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.959897 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.960213 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.960529 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.960854 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.961177 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.961518 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.961821 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.962128 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.962432 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.962735 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.963044 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.963343 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.963669 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.963973 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.964280 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.964581 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.964883 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.965181 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.965484 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.965795 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.966132 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.966438 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.966739 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.967056 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.967360 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.967684 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.967986 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.968285 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.968628 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.968928 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.969252 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.969580 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.970151 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.970485 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.970797 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.971123 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.971447 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.971755 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.972059 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.972370 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.972663 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.972967 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.973276 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.973584 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.973892 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.974199 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.974501 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.974811 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.975112 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.975445 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.975756 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.976060 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.976358 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.976666 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.976976 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.977277 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.977584 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.977886 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.978203 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.978506 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.978815 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.979118 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.979447 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.979757 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.980059 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.980380 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.980689 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.980992 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.981298 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.981612 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.981917 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.982219 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.982525 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.982842 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.983154 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.983478 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.983786 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.984086 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.984386 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.984687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.984993 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.985291 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.985620 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.985922 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.986223 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.986521 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.986836 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.987141 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.987480 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.987787 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.988088 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.988428 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.988732 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.989084 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.989386 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.989699 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.990020 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.990328 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.990639 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.990952 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.991255 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.991592 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.991902 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.992215 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.992519 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.992825 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.993142 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.993450 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.993757 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.994073 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.994391 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.994712 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.995012 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.995318 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.995649 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.995956 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.996262 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.996569 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.996874 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.997184 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.997491 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.997799 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.998107 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.998430 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.998725 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.999032 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.999334 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.999678 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:01.999985 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.000285 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.000592 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.000895 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.001456 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.001901 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.002340 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.002653 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.002965 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.003273 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.003610 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.003926 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.004243 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.004557 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.004860 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.005272 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.005583 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.005893 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.006204 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.006508 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.006812 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.007120 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.007465 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.007609 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:43:02.008070 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.008194 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:43:02.008313 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.008440 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.008653 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.008776 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:43:02.008990 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.009277 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.009398 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:43:02.009690 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.009896 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:43:02.010019 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.010294 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.010427 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.010710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.010954 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.011079 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.011314 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.011541 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.011667 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.011964 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.012092 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.012286 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.012588 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.012711 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.012899 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.013168 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.013292 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.013512 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.013727 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.013851 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.014127 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.014283 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.014441 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.014745 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.014875 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.015068 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.015466 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.015703 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.015932 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.016057 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.016415 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.016545 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-2-iscsi {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.017023 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.017229 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.017446 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.017685 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.017808 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.018087 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.018211 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.018393 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.018696 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.018831 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.019012 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.019275 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.019419 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.019634 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.019884 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.020007 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.020246 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.020425 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.020547 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.020852 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.021160 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.021320 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.021476 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.021750 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.021881 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.022069 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.022370 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.022491 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.022689 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.022933 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.023063 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.023304 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.023544 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.023681 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.023939 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.024101 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.024259 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.024566 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.024688 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.024870 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.025172 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.025294 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.025474 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.025712 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.025834 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.026099 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.026281 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.026405 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.026728 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.026872 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.027068 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.027348 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.027544 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-2-iscsi {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.027704 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.028032 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.028155 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.028347 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.028633 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.028764 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.028979 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.029187 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.029320 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.029567 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.029875 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.030005 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.030177 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.030420 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.030546 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.030764 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.030963 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.031085 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.031355 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.031558 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.031684 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.031962 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.032111 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.032393 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.032779 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.032981 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.033142 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.033345 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.033478 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.033717 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.033895 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.034020 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.034313 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.034435 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.034652 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.034954 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.035088 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.035283 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.035526 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.035650 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.035928 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.036049 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.036253 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.036562 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.036693 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.036883 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.037181 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.037324 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.037499 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.037690 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.037813 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.038107 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.038229 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.038417 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.038585 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.038730 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.039048 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.039170 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.039355 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.039692 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.039815 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.040004 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.040260 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.040382 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.040836 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.040973 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.041170 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.041291 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.041490 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.041726 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.041860 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.042108 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.042296 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.042419 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.042722 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.042879 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.043037 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.043349 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.043503 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.043685 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.043972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.044104 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.044312 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.044507 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.044631 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.044944 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.045065 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.045282 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.045547 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.045671 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.045899 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.046078 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.046201 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.046515 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.046639 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.046868 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.047117 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.047317 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.047539 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.047690 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.047821 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.048231 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.048436 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.048635 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.048817 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.048942 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.049146 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.049346 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.049480 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.049760 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.049892 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.050070 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.050378 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.050550 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.050672 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.050975 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.051099 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.051296 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.051536 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.051723 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.052047 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.052182 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.052362 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.052639 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.052769 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.053016 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.053170 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.053535 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.053716 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.053838 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.054167 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.054296 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.054491 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.054777 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.054900 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.055115 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.055305 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.055448 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.056130 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.056262 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.056437 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.056742 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.056858 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.057052 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.057376 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.057510 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.057651 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.057831 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.057954 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.058340 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.058480 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.058601 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.058775 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.058901 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.059164 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.059295 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.059721 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.059859 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.060069 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.060362 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.060486 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.060695 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.060890 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.061014 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.061321 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.061442 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.061627 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.061905 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.062031 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.062239 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.062419 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.062542 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.062847 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.062978 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.063160 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.063564 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.063716 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.063967 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.064186 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.064346 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.064575 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.064709 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.064880 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.065116 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.065250 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.065487 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.065643 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.065814 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.066122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.066245 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.066428 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.066666 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.066790 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.067028 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.067211 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.067336 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.067654 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.067779 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.067961 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.068263 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.068395 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.068576 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.068815 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.068939 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.069176 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.069348 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.069486 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.069780 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.069910 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.070084 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.070395 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.070529 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.070745 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.070931 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.071055 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.071353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.071514 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.071682 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.072001 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.072140 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.072309 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.072602 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.072733 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.072929 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.073140 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.073347 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.073570 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.073694 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.073886 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.074216 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.074420 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.074753 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.074877 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.075073 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.075286 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.075439 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.075748 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.075872 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.076056 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.076360 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.076484 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.076664 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.076908 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.077026 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.077284 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.077459 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.077657 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.077890 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.078021 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.078200 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.078508 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.078630 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.078821 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.079045 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.079293 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.079495 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.079758 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.079889 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.080096 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.080228 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.080406 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.080712 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.080836 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.081040 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.081171 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.081352 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.081632 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.081758 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.081996 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.082125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.082364 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.082652 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.082779 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.082986 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.083160 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.083283 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.083622 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.083759 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.083933 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.084191 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.084315 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.084544 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.084712 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:43:02.084872 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.085185 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.085307 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.085490 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.085776 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.085913 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.086205 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.086336 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.086522 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.086840 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.086961 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.087149 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.087465 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.087596 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.087799 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.088046 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.088183 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.088390 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.088608 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.088740 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.089013 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.089162 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.089349 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.089673 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.089794 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.089993 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.090270 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.090394 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.090585 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.090821 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.091179 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.091379 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.091518 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.091812 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.091934 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.092113 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.092434 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.092559 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.092755 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.092878 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.093100 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.093402 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.093532 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.093704 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.093937 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.094061 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.094295 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.094467 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.094707 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.095023 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.095155 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.095468 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.095595 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.095772 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.095899 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.096116 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.096426 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.096550 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.096735 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.097009 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.097133 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.097324 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.097538 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.097662 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.097916 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.098105 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.098239 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.098558 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.098689 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.098888 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.099176 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.099299 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.099538 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.099735 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.099892 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.100208 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.100339 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.100602 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.100741 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.100865 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.101172 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.101302 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.101524 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.101723 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.101982 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.102186 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.102355 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.102706 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.102966 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.103098 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.103351 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.103586 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.103722 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.103976 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.104125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.104287 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.104635 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.104765 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.104964 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.105155 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.105279 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.105579 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.105710 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.105893 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.106208 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.106331 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.106540 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.106737 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.106870 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.107162 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.107320 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.107478 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.107794 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.107947 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.108137 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.108407 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.108530 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.108718 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.108933 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.109058 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.109339 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.109486 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.109663 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.109991 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.110121 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.110299 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.110684 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.110842 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.111220 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.111325 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.111709 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.111802 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.112026 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.112294 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.112388 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.112686 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.112824 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.112999 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.113302 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.113610 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.113701 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.113872 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:43:02.114224 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.114781 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.115403 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.115889 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.116437 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.116962 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.117515 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.118085 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.118556 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.119036 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.119563 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.120062 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.120541 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.121040 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.121526 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.122037 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.122572 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.123085 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.123623 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.124153 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.124677 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.125103 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.125589 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.126175 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.126719 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.127183 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.127695 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.128240 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.128865 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.129382 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.129925 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.130470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.130974 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.131521 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.132049 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.132553 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.133048 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.133550 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.134134 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.134663 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.135178 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.135734 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.136267 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.136783 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.137321 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.137846 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.138355 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.138862 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.139381 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.139960 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.140594 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.141166 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.141830 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.142363 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.142891 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.143433 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.143963 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.144478 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.144998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.145525 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.146041 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.146586 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.147113 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.147677 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.148176 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.148699 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.149211 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.149733 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.150235 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.150736 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.151294 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.151873 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.152376 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.152900 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.153408 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.153920 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.154414 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.154925 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.155480 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.156003 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.156547 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.157075 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.157677 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.158247 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.158713 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.159232 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.159798 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.160317 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.160852 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.161403 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.161955 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.162478 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.163010 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.163590 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.164126 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.164670 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.165216 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.165759 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.166286 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.166824 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.167398 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.167943 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.168480 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.169006 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.169551 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.170086 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.170615 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.171136 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.171713 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.172270 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.172811 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.173525 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.174023 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.174558 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.175086 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.175680 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.176229 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.176758 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.177288 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.177475 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO dbcounter [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Registered counter for database nova_api Jun 17 12:43:02.177826 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.178416 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.178949 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.179507 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.180065 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.180984 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.181521 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.182068 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.182608 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.183141 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.183734 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.184283 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.184815 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.185354 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.185890 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.186434 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.186967 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.187574 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.188132 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.188734 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.189280 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.189814 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.190364 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.190926 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.192052 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.193297 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.193297 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.193687 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.194246 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.194804 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.195395 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.195982 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.196584 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.197126 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.197669 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.198207 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.198741 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.199284 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.199562 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_db.sqlalchemy.engines [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.199864 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.200412 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.200952 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.201506 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.202047 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.202585 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.203094 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.203628 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.204377 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.204930 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.205499 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.206054 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.206648 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.206746 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writer thread running {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:02.207227 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.207792 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.208352 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.208904 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.209525 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.210085 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.210782 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.211391 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.212025 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.212584 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.213141 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.213712 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.214221 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.214741 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.215265 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.215829 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.216364 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.216906 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.217451 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.217990 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.218535 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.219071 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.219623 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.220213 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.220745 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.221285 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.221827 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.222352 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.222830 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.223434 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.223972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.224438 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.224903 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.225430 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.225941 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.226442 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.226950 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.227509 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.228064 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.228651 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.229230 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.229846 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.230439 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.231027 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.231658 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.232245 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.232829 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.233414 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.234008 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.234618 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.235089 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.235548 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.235880 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.236283 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.236605 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.236950 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.237522 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.238056 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.238582 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.239061 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.239604 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.240110 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.240637 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.241204 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.241928 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.242474 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.242833 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.243337 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.243881 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.244488 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.244966 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.245603 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.246127 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.246687 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.247242 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.247817 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.248358 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.248936 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.249526 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.250121 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.250679 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.251992 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.252526 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.253065 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.253621 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.254172 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.255103 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.255682 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.256083 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.256416 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.256914 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.257284 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.257801 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.258317 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.258829 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.259340 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.259879 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.260390 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.260945 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.261493 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.262081 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.262640 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.263249 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.263863 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.264405 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.264976 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.265541 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.265638 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.context [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8(cell1) {{(pid=120004) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:43:02.266116 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.266881 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.267663 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.268243 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.268812 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.269345 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.269909 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.270009 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:43:02.270491 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.271081 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.271520 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:43:02.271711 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.272276 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.272372 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:43:02.273010 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.273580 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.274157 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.274268 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:43:02.274732 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.275295 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.275883 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.276316 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO dbcounter [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Registered counter for database nova_cell0 Jun 17 12:43:02.276451 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.276986 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.277547 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.278120 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.278801 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.279458 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.280032 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.280121 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO dbcounter [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Registered counter for database nova_cell1 Jun 17 12:43:02.280643 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.281426 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.282012 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.282739 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.283530 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.284109 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.284686 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.285277 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.285889 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.286506 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.287071 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.287874 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_db.sqlalchemy.engines [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.288215 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.288509 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.289132 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.289767 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.289880 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_db.sqlalchemy.engines [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.290377 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.290964 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.291563 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.292161 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.292751 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.293341 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.293952 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.294770 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.295262 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writer thread running {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:02.295450 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.296046 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.296676 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.297299 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.297738 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writer thread running {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:02.298116 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.298683 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.299281 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.299921 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.300526 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.301144 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.301747 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.302349 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.302963 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.303564 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.304133 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.304690 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.305301 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.306242 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.306857 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.307501 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.308120 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.308748 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.309346 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.309981 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.310591 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.311197 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.311817 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.312414 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.313086 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.313773 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.314365 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.314992 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.315619 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.316187 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.316805 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.317414 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.318025 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.318624 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.319225 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.319827 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.320395 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.320965 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.321536 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.322122 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.322714 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.323325 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.323966 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.324524 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.325093 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.325699 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.326285 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.326897 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.327489 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.328068 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.328660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.329358 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.329988 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.330567 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.331209 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.331871 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.332500 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.333147 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.333754 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.334355 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.334948 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.335572 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.336179 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.336797 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.337404 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.338021 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.338633 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.339239 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.339896 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.340491 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.341082 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.342105 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.342860 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.343499 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.344105 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.344953 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.345352 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.345923 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.346513 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.347104 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.347760 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.348544 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.349183 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.349811 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.350406 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.351074 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.351640 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.352235 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.352825 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.353407 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.354073 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.354665 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.355238 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.355868 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.356451 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.357044 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.357646 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.358251 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.358864 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.359478 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.360065 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.360788 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.361386 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.361989 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.362585 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.363203 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.363832 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.364429 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.365001 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.365589 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.366568 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.367172 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.367899 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.368499 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.369109 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.369711 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.370334 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.370939 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.371573 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.372129 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.372710 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.373300 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.373855 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.374453 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.375035 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.375625 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.376284 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.376863 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.377845 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.378474 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.379061 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.379721 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.380329 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.380921 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.381482 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.382073 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.382632 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.383192 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.383807 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.384401 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.384962 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.385530 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.386119 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.386705 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.387267 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.387883 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.388451 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.389054 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.389624 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.390201 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.390760 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.391351 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.392081 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.392637 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.393205 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.393764 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.394350 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.394927 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.395564 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.396164 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.396763 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.397360 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.397957 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.398631 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.399226 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.399824 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.400384 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.400985 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.401572 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.402186 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.402763 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.403330 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.403984 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.404558 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.405551 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.406170 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.406779 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.407499 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.408101 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.408669 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.409232 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.409810 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.410426 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.411006 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.411633 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.412236 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.412841 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.413435 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.414016 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.414598 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.415170 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.415788 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.416374 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.416948 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.417537 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.418115 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.418732 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.419402 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.419987 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.420574 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.421167 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.421765 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.422340 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.423126 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.423671 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.424244 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.424822 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.425417 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.426011 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.426581 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.427357 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.427973 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.428575 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.429172 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.429751 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.430338 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.431285 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.431898 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.432483 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.433059 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.433680 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.434323 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.434943 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.435595 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.436179 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.436762 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.437346 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.437918 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.438633 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.439229 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.439841 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.440425 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.441034 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.441600 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.442175 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.442757 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.442879 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO dbcounter [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Registered counter for database nova_cell0 Jun 17 12:43:02.443505 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.444093 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.444641 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.445324 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.445883 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.446445 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.447024 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.447612 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.448194 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.448768 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.449335 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.449705 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_db.sqlalchemy.engines [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.449898 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.450482 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.451045 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.451687 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.452294 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.452879 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.453479 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.454069 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.454174 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writer thread running {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:02.454765 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.455398 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.455998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.456583 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.457166 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.457738 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.458345 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.458938 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.459538 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.460101 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.460665 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.461231 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.461799 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.462399 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.463003 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.463620 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.464243 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.464941 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.465526 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.466114 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.466697 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.467299 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.467908 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.468480 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.469072 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.469647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.470394 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.470986 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.471622 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.472240 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.472862 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.473428 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.474035 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.474653 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.475305 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.475935 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.476712 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.477357 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.477981 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.478674 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.479353 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:43:02.479921 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:43:02.605755 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO dbcounter [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Registered counter for database nova_api Jun 17 12:43:02.638357 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_db.sqlalchemy.engines [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.646801 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writer thread running {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:02.712138 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.context [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8(cell1) {{(pid=120003) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:43:02.716345 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_concurrency.lockutils [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:43:02.718034 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_concurrency.lockutils [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:43:02.718824 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_concurrency.lockutils [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:43:02.721019 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_concurrency.lockutils [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:43:02.723057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO dbcounter [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Registered counter for database nova_cell0 Jun 17 12:43:02.726909 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO dbcounter [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Registered counter for database nova_cell1 Jun 17 12:43:02.736237 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_db.sqlalchemy.engines [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.739747 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_db.sqlalchemy.engines [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.742601 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writer thread running {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:02.788466 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: WARNING keystonemiddleware.auth_token [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:43:02.795756 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: WARNING keystonemiddleware.auth_token [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:43:02.884702 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writer thread running {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:02.895278 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO dbcounter [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Registered counter for database nova_cell0 Jun 17 12:43:02.904404 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG oslo_db.sqlalchemy.engines [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:43:02.910040 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writer thread running {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:43:03.136253 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: WARNING keystonemiddleware.auth_token [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:43:03.142456 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: WARNING keystonemiddleware.auth_token [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:43:03.147726 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbb41109c0 pid: 120004 (default app) Jun 17 12:43:03.149789 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:43:03.150987 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] 10.222.0.87 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jun 17 12:43:03.151399 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 788 bytes} [Fri Jun 17 12:43:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:43:03.224406 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: WARNING keystonemiddleware.auth_token [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:43:03.231703 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: WARNING keystonemiddleware.auth_token [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:43:03.580290 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: WARNING keystonemiddleware.auth_token [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:43:03.586272 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: WARNING keystonemiddleware.auth_token [None req-a17d4cbd-0c9a-48bf-ab59-da087369c677 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:43:03.591580 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbb41109c0 pid: 120003 (default app) Jun 17 12:44:20.329475 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:20.331222 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Jun 17 12:44:20.336961 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 2/2] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:20.345164 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writing DB stats nova_api:SELECT=3 {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:20.346643 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writing DB stats nova_cell0:SELECT=3 {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:20.348009 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writing DB stats nova_cell1:SELECT=3 {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:20.348808 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writing DB stats nova_cell0:SELECT=3 {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:20.789530 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-0b0ab4ba-c5ad-414c-a141-128fbac87bbe admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:20.819132 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-0b0ab4ba-c5ad-414c-a141-128fbac87bbe admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480126 Jun 17 12:44:20.819736 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 1/3] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Jun 17 12:44:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:22.981623 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:22.982637 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-0d8e5a6d-27a1-4230-b8cb-71dba52ebd80 None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 17 12:44:22.983006 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 3/4] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:23.047193 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-1056037d-0160-44e4-9e3b-d7cbec5b464c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:23.065969 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:44:23.065969 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: warnings.warn(msg) Jun 17 12:44:23.095059 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-1056037d-0160-44e4-9e3b-d7cbec5b464c admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105409 Jun 17 12:44:23.095756 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 2/5] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:23.109442 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_api:SELECT=3 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.110241 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_cell0:SELECT=3 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.111232 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_cell1:SELECT=3 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.112304 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.315907 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-c525c289-9bb6-491a-9064-e5674e27d8ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:23.319060 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:44:23.319060 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: warnings.warn(msg) Jun 17 12:44:23.394139 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-c525c289-9bb6-491a-9064-e5674e27d8ea admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289926 Jun 17 12:44:23.394761 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 4/6] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Jun 17 12:44:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:25.578461 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-1056037d-0160-44e4-9e3b-d7cbec5b464c admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:25.579512 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-1056037d-0160-44e4-9e3b-d7cbec5b464c admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 17 12:44:25.579929 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 3/7] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:25.695619 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-1b20f11b-4e6a-4ae5-80e9-2ccf14b53c98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "disk": 5}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:25.713532 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:44:25.713532 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: warnings.warn(msg) Jun 17 12:44:25.735067 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-1b20f11b-4e6a-4ae5-80e9-2ccf14b53c98 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148908 Jun 17 12:44:25.735415 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 5/8] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:25.751486 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-16a626b7-9edd-490c-b17d-00888ff6489f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:25.753158 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:44:25.753158 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: warnings.warn(msg) Jun 17 12:44:25.792160 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-16a626b7-9edd-490c-b17d-00888ff6489f admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048104 Jun 17 12:44:25.792753 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 4/9] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Jun 17 12:44:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:44:27.959855 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-1b20f11b-4e6a-4ae5-80e9-2ccf14b53c98 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:27.960885 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-1b20f11b-4e6a-4ae5-80e9-2ccf14b53c98 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 17 12:44:27.961274 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 6/10] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:28.021393 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-17bcb726-3ee0-46d0-8412-1b3698ecf583 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "swap": 0}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:28.042310 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-17bcb726-3ee0-46d0-8412-1b3698ecf583 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075132 Jun 17 12:44:28.043054 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 5/11] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:44:28.054730 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-16ec0473-ace2-461e-ab95-7989266556a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:28.084111 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-16ec0473-ace2-461e-ab95-7989266556a7 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033206 Jun 17 12:44:28.085465 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 7/12] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Jun 17 12:44:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:44:30.275238 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-17bcb726-3ee0-46d0-8412-1b3698ecf583 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:30.276287 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-17bcb726-3ee0-46d0-8412-1b3698ecf583 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 17 12:44:30.276696 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 6/13] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:30.336931 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-ac3165f5-8fb8-44c1-b3e0-4951050ab356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:30.356760 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-ac3165f5-8fb8-44c1-b3e0-4951050ab356 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074207 Jun 17 12:44:30.357578 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 8/14] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:44:30.369353 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-bffe7285-2ddc-4b03-a1c4-04695c0f1a69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:30.394176 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-bffe7285-2ddc-4b03-a1c4-04695c0f1a69 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028600 Jun 17 12:44:30.394913 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 7/15] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Jun 17 12:44:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:32.623534 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-ac3165f5-8fb8-44c1-b3e0-4951050ab356 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:32.624543 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-ac3165f5-8fb8-44c1-b3e0-4951050ab356 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 17 12:44:32.625217 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 9/16] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:32.689867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-20e012fb-2bdd-47fe-91b5-9819821dbd55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:32.709876 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-20e012fb-2bdd-47fe-91b5-9819821dbd55 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078969 Jun 17 12:44:32.717973 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 8/17] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:32.722913 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-1d509578-2d22-428e-a7f3-5fec9e1a787f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:32.747310 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-1d509578-2d22-428e-a7f3-5fec9e1a787f admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028005 Jun 17 12:44:32.751840 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 10/18] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Jun 17 12:44:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:34.912975 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-20e012fb-2bdd-47fe-91b5-9819821dbd55 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:34.914125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-20e012fb-2bdd-47fe-91b5-9819821dbd55 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 17 12:44:34.914483 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 9/19] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:34.980328 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-c9740e2a-7442-42ef-8eb4-0eb1306e9050 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:35.003519 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-c9740e2a-7442-42ef-8eb4-0eb1306e9050 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082821 Jun 17 12:44:35.004240 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 11/20] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Jun 17 12:44:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:44:37.195868 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-20e012fb-2bdd-47fe-91b5-9819821dbd55 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:37.196897 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-20e012fb-2bdd-47fe-91b5-9819821dbd55 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jun 17 12:44:37.197342 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 10/21] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:37.261097 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-3a199786-1308-46cd-a5d6-2343be9d3775 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:37.280463 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-3a199786-1308-46cd-a5d6-2343be9d3775 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075160 Jun 17 12:44:37.281047 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 12/22] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:37.295167 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-2a476ba9-94fd-46fd-9975-6460facc4f76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:37.326117 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-2a476ba9-94fd-46fd-9975-6460facc4f76 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036086 Jun 17 12:44:37.326614 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 11/23] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Jun 17 12:44:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:39.783258 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-3a199786-1308-46cd-a5d6-2343be9d3775 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:39.784399 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-3a199786-1308-46cd-a5d6-2343be9d3775 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Jun 17 12:44:39.784863 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 13/24] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:39.852395 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-8c20644b-288a-48d5-9b4b-0facf024e6fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "id": "2", "ram": 2048, "name": "m1.small", "swap": 0}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:39.871707 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-8c20644b-288a-48d5-9b4b-0facf024e6fc admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080254 Jun 17 12:44:39.872311 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 12/25] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:39.885416 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-772c0b58-793c-487a-ae11-99fb7c5e40d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:39.913630 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-772c0b58-793c-487a-ae11-99fb7c5e40d3 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031908 Jun 17 12:44:39.914534 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 14/26] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Jun 17 12:44:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:42.135201 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-8c20644b-288a-48d5-9b4b-0facf024e6fc admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:42.136331 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-8c20644b-288a-48d5-9b4b-0facf024e6fc admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jun 17 12:44:42.136723 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 13/27] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:42.198902 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-142d4b9e-95b2-4d55-a37b-9ff4bd391388 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:42.219004 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-142d4b9e-95b2-4d55-a37b-9ff4bd391388 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076113 Jun 17 12:44:42.219686 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 15/28] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:44:42.232130 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-7c1309bf-a856-4730-8c55-ffab6c5b637e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:42.257482 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-7c1309bf-a856-4730-8c55-ffab6c5b637e admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029001 Jun 17 12:44:42.258225 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 14/29] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Jun 17 12:44:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:44.410382 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-142d4b9e-95b2-4d55-a37b-9ff4bd391388 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:44.411406 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-142d4b9e-95b2-4d55-a37b-9ff4bd391388 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 17 12:44:44.411820 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 16/30] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:44.472393 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-2cefb91f-08c2-4411-8267-5d42199743d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:44.492407 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-2cefb91f-08c2-4411-8267-5d42199743d7 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074264 Jun 17 12:44:44.493003 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 15/31] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:44:44.505251 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-c0cd6b01-d7e1-49e4-87cc-52df764ecea2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:44.529371 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-c0cd6b01-d7e1-49e4-87cc-52df764ecea2 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027842 Jun 17 12:44:44.529933 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 17/32] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Jun 17 12:44:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:46.841509 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-2cefb91f-08c2-4411-8267-5d42199743d7 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:44:46.842554 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-2cefb91f-08c2-4411-8267-5d42199743d7 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 17 12:44:46.842964 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 16/33] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:44:46.902581 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-8fb1e182-44be-469c-88ca-69ac71a48da4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:46.922273 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-8fb1e182-44be-469c-88ca-69ac71a48da4 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073410 Jun 17 12:44:46.922823 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 18/34] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Jun 17 12:44:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:46.934924 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9c12e373-33cc-493b-9fe5-cd36b06b86e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:44:46.960474 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-9c12e373-33cc-493b-9fe5-cd36b06b86e1 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029262 Jun 17 12:44:46.961371 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 17/35] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Jun 17 12:44:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:45:11.231136 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-8fb1e182-44be-469c-88ca-69ac71a48da4 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:11.232193 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-8fb1e182-44be-469c-88ca-69ac71a48da4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 17 12:45:11.232629 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 19/36] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:11.246369 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:11.297745 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f5d71a66-ece9-4c96-becc-e873342f4b69 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:11.315080 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f5d71a66-ece9-4c96-becc-e873342f4b69 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075480 Jun 17 12:45:11.315646 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 18/37] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Jun 17 12:45:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:45:12.302690 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-8fb1e182-44be-469c-88ca-69ac71a48da4 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:12.303706 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-8fb1e182-44be-469c-88ca-69ac71a48da4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 17 12:45:12.304102 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 20/38] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:12.520342 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9d4e8036-0429-4bb2-b4fc-9400ca922e86 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:12.529066 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.wsgi [None req-9d4e8036-0429-4bb2-b4fc-9400ca922e86 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9d4e8036-0429-4bb2-b4fc-9400ca922e86 admin admin] Request method failure captured: Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Accept: application/json Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Accept-Encoding: gzip, deflate Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Connection: keep-alive Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Content-Length: 0 Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Host: 10.222.0.87 Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Openstack-Api-Version: compute 2.90 Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Openstack-System-Scope: None Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: User-Agent: python-novaclient Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Auth-Token: gAAAAABirHdYs2mxRjtclKvnaSFo-9Hbr4XkOnw2DtmXuXOEXqeQGB6P7eomdRwRPm1vPx0RWNQaM7lo6CmMGxzrf4bdCN14lwV46eEichL4oGUfCkE1NQPmpaCqqdIAYKdwIE_anHhtvdnvLnbiE-3lSqYHH6V9IPIrzxAf-KfKs6xg8jhaQps Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Domain-Id: None Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Domain-Name: None Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Identity-Status: Confirmed Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Is-Admin-Project: True Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Domain-Id: default Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Domain-Name: Default Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Name: admin Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Role: reader,member,admin Jun 17 12:45:12.534261 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Roles: reader,member,admin Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a8cba89e292b47ef9da2168f3c55b232", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant: admin Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant-Name: admin Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User: admin Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Domain-Id: default Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Domain-Name: Default Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Id: 546aa1cc97e64f3e87a1b21e2088baa8 Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Name: admin Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: method: > Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: exception: Flavor 42 could not be found. Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: action_args: {'id': '42'} Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:45:12.535998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:12.537057 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.538660 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9d4e8036-0429-4bb2-b4fc-9400ca922e86 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:45:12.540014 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-9d4e8036-0429-4bb2-b4fc-9400ca922e86 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.079782 Jun 17 12:45:12.540014 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 19/39] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Jun 17 12:45:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:45:12.545804 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-8d9bda3e-dfea-4c1f-a878-14dc4161fd65 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:12.548916 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:12.569086 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-8d9bda3e-dfea-4c1f-a878-14dc4161fd65 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026866 Jun 17 12:45:12.569638 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 21/40] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Jun 17 12:45:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:45:12.582411 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-d7118ab5-2a8c-4eae-bd93-0c8f2d4c36c8 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:12.605881 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-d7118ab5-2a8c-4eae-bd93-0c8f2d4c36c8 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029353 Jun 17 12:45:12.606433 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 20/41] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Jun 17 12:45:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:45:12.616000 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-e7d0b246-0cd9-4b14-8479-49791bff6cc9 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:12.622577 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.wsgi [None req-e7d0b246-0cd9-4b14-8479-49791bff6cc9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-e7d0b246-0cd9-4b14-8479-49791bff6cc9 admin admin] Request method failure captured: Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Accept: application/json Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Accept-Encoding: gzip, deflate Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Connection: keep-alive Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Content-Length: 0 Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Host: 10.222.0.87 Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Openstack-Api-Version: compute 2.90 Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Openstack-System-Scope: None Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: User-Agent: python-novaclient Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Auth-Token: gAAAAABirHdYs2mxRjtclKvnaSFo-9Hbr4XkOnw2DtmXuXOEXqeQGB6P7eomdRwRPm1vPx0RWNQaM7lo6CmMGxzrf4bdCN14lwV46eEichL4oGUfCkE1NQPmpaCqqdIAYKdwIE_anHhtvdnvLnbiE-3lSqYHH6V9IPIrzxAf-KfKs6xg8jhaQps Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Domain-Id: None Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Domain-Name: None Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Identity-Status: Confirmed Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Is-Admin-Project: True Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Domain-Id: default Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Domain-Name: Default Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Name: admin Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Role: reader,member,admin Jun 17 12:45:12.625878 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Roles: reader,member,admin Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a8cba89e292b47ef9da2168f3c55b232", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant: admin Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant-Name: admin Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User: admin Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Domain-Id: default Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Domain-Name: Default Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Id: 546aa1cc97e64f3e87a1b21e2088baa8 Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Name: admin Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: method: > Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: exception: Flavor 42 could not be found. Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: action_args: {'id': '42'} Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:45:12.627353 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:12.628245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:12.629337 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-e7d0b246-0cd9-4b14-8479-49791bff6cc9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120004) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:45:12.630313 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-e7d0b246-0cd9-4b14-8479-49791bff6cc9 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014967 Jun 17 12:45:12.630313 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 22/42] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Jun 17 12:45:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:45:13.504971 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-d7118ab5-2a8c-4eae-bd93-0c8f2d4c36c8 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:13.505996 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-d7118ab5-2a8c-4eae-bd93-0c8f2d4c36c8 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 17 12:45:13.506394 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 21/43] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:13.702880 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-f27ed2a6-07bf-40a0-99c2-3145e4427a73 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:13.709168 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.wsgi [None req-f27ed2a6-07bf-40a0-99c2-3145e4427a73 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-f27ed2a6-07bf-40a0-99c2-3145e4427a73 admin admin] Request method failure captured: Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Accept: application/json Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Accept-Encoding: gzip, deflate Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Connection: keep-alive Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Content-Length: 0 Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Host: 10.222.0.87 Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Openstack-Api-Version: compute 2.90 Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Openstack-System-Scope: None Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: User-Agent: python-novaclient Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Auth-Token: gAAAAABirHdZsfKP0JHvRcejbNAkPgklQhArUUsUynpT1DXMy4dtu1hANScsEsEZTpvktS2WHs79i2HLaQmJbOOFqtGMU1oqEOYOa7BZHq72ZWXBtvrEdUtoA_Wt7VYz0G91yJx-LMPRSEoO34oy4RABQVf8A7Q7DJjaVYxq0CkNkq3DCIPnZH0 Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Domain-Id: None Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Domain-Name: None Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Identity-Status: Confirmed Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Is-Admin-Project: True Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Domain-Id: default Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Domain-Name: Default Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Name: admin Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Role: reader,member,admin Jun 17 12:45:13.710616 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Roles: reader,member,admin Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a8cba89e292b47ef9da2168f3c55b232", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant: admin Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant-Name: admin Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User: admin Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Domain-Id: default Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Domain-Name: Default Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Id: 546aa1cc97e64f3e87a1b21e2088baa8 Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Name: admin Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: method: > Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: exception: Flavor 84 could not be found. Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: action_args: {'id': '84'} Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:45:13.712152 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:13.713245 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.714710 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-f27ed2a6-07bf-40a0-99c2-3145e4427a73 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120004) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:45:13.716029 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-f27ed2a6-07bf-40a0-99c2-3145e4427a73 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068459 Jun 17 12:45:13.716029 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 23/44] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Jun 17 12:45:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:45:13.721903 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-32d5d82c-df64-4fce-ac54-b27ba9c61a9e admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:13.735969 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-32d5d82c-df64-4fce-ac54-b27ba9c61a9e admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017683 Jun 17 12:45:13.736495 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 22/45] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Jun 17 12:45:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:45:13.746083 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-df011200-c1f0-4d6a-8224-1dd2becca7ca admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:13.759995 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-df011200-c1f0-4d6a-8224-1dd2becca7ca admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017607 Jun 17 12:45:13.760588 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 24/46] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Jun 17 12:45:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:45:13.770226 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-e405dfc6-fa7d-43a0-a74a-b98c8f0d8752 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:13.775827 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.wsgi [None req-e405dfc6-fa7d-43a0-a74a-b98c8f0d8752 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-e405dfc6-fa7d-43a0-a74a-b98c8f0d8752 admin admin] Request method failure captured: Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Accept: application/json Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Accept-Encoding: gzip, deflate Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Connection: keep-alive Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Content-Length: 0 Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Host: 10.222.0.87 Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Openstack-Api-Version: compute 2.90 Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Openstack-System-Scope: None Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: User-Agent: python-novaclient Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Auth-Token: gAAAAABirHdZsfKP0JHvRcejbNAkPgklQhArUUsUynpT1DXMy4dtu1hANScsEsEZTpvktS2WHs79i2HLaQmJbOOFqtGMU1oqEOYOa7BZHq72ZWXBtvrEdUtoA_Wt7VYz0G91yJx-LMPRSEoO34oy4RABQVf8A7Q7DJjaVYxq0CkNkq3DCIPnZH0 Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Domain-Id: None Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Domain-Name: None Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Identity-Status: Confirmed Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Is-Admin-Project: True Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Domain-Id: default Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Domain-Name: Default Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Name: admin Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Role: reader,member,admin Jun 17 12:45:13.777470 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Roles: reader,member,admin Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a8cba89e292b47ef9da2168f3c55b232", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant: admin Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant-Name: admin Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User: admin Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Domain-Id: default Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Domain-Name: Default Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Id: 546aa1cc97e64f3e87a1b21e2088baa8 Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Name: admin Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: method: > Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: exception: Flavor 84 could not be found. Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: action_args: {'id': '84'} Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:45:13.778972 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:13.779867 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:13.780919 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-e405dfc6-fa7d-43a0-a74a-b98c8f0d8752 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:45:13.781918 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-e405dfc6-fa7d-43a0-a74a-b98c8f0d8752 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012233 Jun 17 12:45:13.781918 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 23/47] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Jun 17 12:45:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:45:14.687330 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-df011200-c1f0-4d6a-8224-1dd2becca7ca admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:14.688357 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-df011200-c1f0-4d6a-8224-1dd2becca7ca admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 17 12:45:14.688749 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 25/48] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:14.887751 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-d2748da1-c978-4f1b-a3da-914d5b7d27d2 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:14.895119 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.wsgi [None req-d2748da1-c978-4f1b-a3da-914d5b7d27d2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-d2748da1-c978-4f1b-a3da-914d5b7d27d2 admin admin] Request method failure captured: Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Accept: application/json Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Accept-Encoding: gzip, deflate Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Connection: keep-alive Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Content-Length: 0 Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Host: 10.222.0.87 Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Openstack-Api-Version: compute 2.90 Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Openstack-System-Scope: None Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: User-Agent: python-novaclient Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Auth-Token: gAAAAABirHdaXKQ8NUUEApjet9LeahLnv26HAZ5ed-lK6fWE_a_Bqyk6Ns54iifutd1TYe_PVy3QBRv95RlzbOElUhv9sMz9Jz0glmntJJhEJNI3nWSAjx-Nn18j3SvqbNW1THvHOTZPXnROtbMlsBXLtewpVz6VNy63C1P_OgBIGvCBuRc4UzE Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Domain-Id: None Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Domain-Name: None Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Identity-Status: Confirmed Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Is-Admin-Project: True Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Domain-Id: default Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Domain-Name: Default Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Project-Name: admin Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Role: reader,member,admin Jun 17 12:45:14.896647 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Roles: reader,member,admin Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a8cba89e292b47ef9da2168f3c55b232", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant: admin Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-Tenant-Name: admin Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User: admin Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Domain-Id: default Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Domain-Name: Default Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Id: 546aa1cc97e64f3e87a1b21e2088baa8 Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: X-User-Name: admin Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: method: > Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: exception: Flavor 451 could not be found. Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: action_args: {'id': '451'} Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:45:14.898125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:14.899125 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.900570 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-d2748da1-c978-4f1b-a3da-914d5b7d27d2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:45:14.901966 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-d2748da1-c978-4f1b-a3da-914d5b7d27d2 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069657 Jun 17 12:45:14.901966 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 24/49] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Jun 17 12:45:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:45:14.907777 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-66104ac7-1e3a-4b53-a2f8-e80d6474a133 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:14.922950 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-66104ac7-1e3a-4b53-a2f8-e80d6474a133 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018739 Jun 17 12:45:14.923521 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 26/50] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Jun 17 12:45:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:45:14.933148 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:14.947228 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017823 Jun 17 12:45:14.948096 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 25/51] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Jun 17 12:45:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:45:14.956897 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-c2110f98-47fa-48b3-8f41-7b0b6f0ad581 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:14.962285 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.wsgi [None req-c2110f98-47fa-48b3-8f41-7b0b6f0ad581 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-c2110f98-47fa-48b3-8f41-7b0b6f0ad581 admin admin] Request method failure captured: Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Accept: application/json Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Accept-Encoding: gzip, deflate Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Connection: keep-alive Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Content-Length: 0 Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Host: 10.222.0.87 Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Openstack-Api-Version: compute 2.90 Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Openstack-System-Scope: None Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: User-Agent: python-novaclient Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Auth-Token: gAAAAABirHdaXKQ8NUUEApjet9LeahLnv26HAZ5ed-lK6fWE_a_Bqyk6Ns54iifutd1TYe_PVy3QBRv95RlzbOElUhv9sMz9Jz0glmntJJhEJNI3nWSAjx-Nn18j3SvqbNW1THvHOTZPXnROtbMlsBXLtewpVz6VNy63C1P_OgBIGvCBuRc4UzE Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Domain-Id: None Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Domain-Name: None Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Identity-Status: Confirmed Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Is-Admin-Project: True Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Domain-Id: default Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Domain-Name: Default Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Project-Name: admin Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Role: reader,member,admin Jun 17 12:45:14.964122 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Roles: reader,member,admin Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a8cba89e292b47ef9da2168f3c55b232", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a8cba89e292b47ef9da2168f3c55b232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant: admin Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant-Id: a8cba89e292b47ef9da2168f3c55b232 Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-Tenant-Name: admin Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User: admin Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Domain-Id: default Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Domain-Name: Default Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Id: 546aa1cc97e64f3e87a1b21e2088baa8 Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: X-User-Name: admin Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: method: > Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: exception: Flavor 451 could not be found. Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: action_args: {'id': '451'} Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:45:14.965687 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:14.966676 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: ERROR nova.api.openstack.wsgi Jun 17 12:45:14.967975 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-c2110f98-47fa-48b3-8f41-7b0b6f0ad581 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120004) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:45:14.969231 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-c2110f98-47fa-48b3-8f41-7b0b6f0ad581 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012103 Jun 17 12:45:14.969231 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 27/52] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Jun 17 12:45:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:45:15.834998 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:15.836055 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 17 12:45:15.836454 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 26/53] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:16.044716 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-4fde43a0-53b3-49a1-a926-29652da6eb48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:45:16.065142 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-4fde43a0-53b3-49a1-a926-29652da6eb48 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.090448 Jun 17 12:45:16.065677 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 28/54] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Jun 17 12:45:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:16.962357 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:16.963396 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 17 12:45:16.963800 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 27/55] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:17.162249 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-616a784b-0349-4697-bd12-d31b0a6dc400 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:45:17.181725 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-616a784b-0349-4697-bd12-d31b0a6dc400 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.079476 Jun 17 12:45:17.182520 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 29/56] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Jun 17 12:45:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:18.058859 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:18.059937 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 17 12:45:18.060337 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 28/57] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:18.266100 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-901b5c4e-9cfb-4769-9eca-6df201d5269d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:45:18.285372 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-901b5c4e-9cfb-4769-9eca-6df201d5269d admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.086313 Jun 17 12:45:18.285910 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 30/58] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Jun 17 12:45:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:19.159751 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:19.160731 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 17 12:45:19.161152 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 29/59] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:19.367531 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-2e3e0af7-8df0-4936-bfcd-d88b4fef7b66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:45:19.390574 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-2e3e0af7-8df0-4936-bfcd-d88b4fef7b66 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.090258 Jun 17 12:45:19.391116 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 31/60] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Jun 17 12:45:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:20.267295 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:20.268400 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 17 12:45:20.268798 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 30/61] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:45:20.468090 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-9f209e83-537b-4e5e-b84d-8805b109b781 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:45:20.487286 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-9f209e83-537b-4e5e-b84d-8805b109b781 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075705 Jun 17 12:45:20.487851 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 32/62] 10.222.0.87 () {60 vars in 1202 bytes} [Fri Jun 17 12:45:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:46:08.769207 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:46:08.770214 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-f43456c7-ff00-4867-8b09-6ec47d83ec91 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 17 12:46:08.770608 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 31/63] 10.222.0.87 () {54 vars in 930 bytes} [Fri Jun 17 12:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:46:08.783920 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:08.836201 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-6bd712e7-df35-4ddc-9a31-f9b679af2911 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:46:08.856019 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-6bd712e7-df35-4ddc-9a31-f9b679af2911 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078613 Jun 17 12:46:08.856626 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 33/64] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Jun 17 12:46:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:46:08.882775 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-935cc492-de63-47d0-8074-e76164b7b893 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:46:08.887802 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG dbcounter [-] [120003] Writing DB stats nova_api:SELECT=14 {{(pid=120003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:08.894075 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-935cc492-de63-47d0-8074-e76164b7b893 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017509 Jun 17 12:46:08.894613 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 32/65] 10.222.0.87 () {60 vars in 1282 bytes} [Fri Jun 17 12:46:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:46:08.906299 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-9861ee23-799b-4c80-b353-2914d0645714 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:46:08.914451 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-9861ee23-799b-4c80-b353-2914d0645714 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011763 Jun 17 12:46:08.914958 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 34/66] 10.222.0.87 () {60 vars in 1285 bytes} [Fri Jun 17 12:46:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:46:08.926995 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:46:08.934836 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011670 Jun 17 12:46:08.935353 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 33/67] 10.222.0.87 () {60 vars in 1285 bytes} [Fri Jun 17 12:46:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:46:08.947139 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-f5391507-1d16-4eec-b693-2da2df75685f admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:46:08.956547 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-f5391507-1d16-4eec-b693-2da2df75685f admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012985 Jun 17 12:46:08.957098 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 35/68] 10.222.0.87 () {60 vars in 1282 bytes} [Fri Jun 17 12:46:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:49:25.226859 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:25.227876 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 17 12:49:25.228274 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 34/69] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:25.388288 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_api:SELECT=6 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:25.510089 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-6258e697-4b21-43f1-8085-a5d02fb510c3 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:25.511253 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:25.511253 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: warnings.warn(msg) Jun 17 12:49:25.512547 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-6258e697-4b21-43f1-8085-a5d02fb510c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:25.513012 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-6258e697-4b21-43f1-8085-a5d02fb510c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:25.513795 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-6258e697-4b21-43f1-8085-a5d02fb510c3 admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:25.514385 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-6258e697-4b21-43f1-8085-a5d02fb510c3 admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:25.547965 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-6258e697-4b21-43f1-8085-a5d02fb510c3 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162401 Jun 17 12:49:25.548516 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 36/70] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Jun 17 12:49:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:49:26.434711 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:26.435780 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 17 12:49:26.436151 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 35/71] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:26.634929 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-b417560e-b164-48d6-8274-62db3d345236 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:26.636158 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:26.636158 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: warnings.warn(msg) Jun 17 12:49:26.637343 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-b417560e-b164-48d6-8274-62db3d345236 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:26.637804 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-b417560e-b164-48d6-8274-62db3d345236 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:26.638680 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-b417560e-b164-48d6-8274-62db3d345236 admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:26.639133 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-b417560e-b164-48d6-8274-62db3d345236 admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:26.659494 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-b417560e-b164-48d6-8274-62db3d345236 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080051 Jun 17 12:49:26.660066 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 37/72] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Jun 17 12:49:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:49:37.955908 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:37.957561 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002366 Jun 17 12:49:37.958064 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 36/73] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:38.107242 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_cell0:SELECT=4 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:38.107984 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_cell1:SELECT=4 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:38.108629 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG dbcounter [-] [120004] Writing DB stats nova_api:SELECT=8 {{(pid=120004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:38.164796 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-0abb4463-7a5f-4ce7-8343-da02c660cd3c admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:38.165962 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:38.165962 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: warnings.warn(msg) Jun 17 12:49:38.167144 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0abb4463-7a5f-4ce7-8343-da02c660cd3c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:38.167618 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0abb4463-7a5f-4ce7-8343-da02c660cd3c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:38.168413 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0abb4463-7a5f-4ce7-8343-da02c660cd3c admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:38.168829 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-0abb4463-7a5f-4ce7-8343-da02c660cd3c admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:38.193698 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-0abb4463-7a5f-4ce7-8343-da02c660cd3c admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090894 Jun 17 12:49:38.194248 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 38/74] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Jun 17 12:49:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:49:39.098586 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: DEBUG nova.api.openstack.wsgi [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] Calling method '>' {{(pid=120003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:39.099935 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: INFO nova.api.openstack.requestlog [None req-9f2001ba-f545-430e-a502-ef4e529e6de1 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 17 12:49:39.100331 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: [pid: 120003|app: 0|req: 37/75] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Jun 17 12:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:39.307080 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG nova.api.openstack.wsgi [None req-68d53c12-a6b5-4bb7-9eea-30ee0fe6bd74 admin admin] Calling method '>' {{(pid=120004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:39.308278 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:39.308278 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: warnings.warn(msg) Jun 17 12:49:39.309509 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-68d53c12-a6b5-4bb7-9eea-30ee0fe6bd74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:39.309945 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-68d53c12-a6b5-4bb7-9eea-30ee0fe6bd74 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:39.310723 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-68d53c12-a6b5-4bb7-9eea-30ee0fe6bd74 admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:49:39.311150 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: DEBUG oslo_concurrency.lockutils [None req-68d53c12-a6b5-4bb7-9eea-30ee0fe6bd74 admin admin] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:49:39.333999 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: INFO nova.api.openstack.requestlog [None req-68d53c12-a6b5-4bb7-9eea-30ee0fe6bd74 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095269 Jun 17 12:49:39.334633 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: [pid: 120004|app: 0|req: 39/76] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Jun 17 12:49:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:38.229353 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: Fri Jun 17 12:50:38 2022 - graceful shutdown triggered... Jun 17 12:50:38.229881 dv-cinder-846172-2-iscsi devstack@n-api.service[120004]: Gracefully killing worker 2 (pid: 120004)... Jun 17 12:50:38.229426 dv-cinder-846172-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 12:50:38.230730 dv-cinder-846172-2-iscsi devstack@n-api.service[120003]: Gracefully killing worker 1 (pid: 120003)... Jun 17 12:50:39.229658 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: worker 1 buried after 1 seconds Jun 17 12:50:39.229658 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: worker 2 buried after 1 seconds Jun 17 12:50:39.229658 dv-cinder-846172-2-iscsi devstack@n-api.service[120002]: goodbye to uWSGI. Jun 17 12:50:39.232196 dv-cinder-846172-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 12:50:39.233185 dv-cinder-846172-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 12:50:39.237482 dv-cinder-846172-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 12:50:39.252314 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 12:50:39 2022] *** Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: nodename: dv-cinder-846172-2-iscsi Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: machine: x86_64 Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: clock source: unix Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: pcre jit disabled Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: detected number of CPU cores: 4 Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: current working directory: / Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: detected binary path: /usr/bin/uwsgi-core Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: your processes number limit is 47680 Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: your memory page size is 4096 bytes Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: detected max file descriptor number: 2048 Jun 17 12:50:39.255006 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: lock engine: pthread robust mutexes Jun 17 12:50:39.256053 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: thunder lock: enabled Jun 17 12:50:39.256053 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 12:50:39.256053 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 12:50:39.299089 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: Python main interpreter initialized at 0x55ab9822d9c0 Jun 17 12:50:39.299089 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: python threads support enabled Jun 17 12:50:39.299089 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: your server socket listen backlog is limited to 100 connections Jun 17 12:50:39.299089 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: your mercy for graceful operations on workers is 90 seconds Jun 17 12:50:39.299596 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 12:50:39.299596 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: *** Operational MODE: preforking *** Jun 17 12:50:39.299869 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: *** uWSGI is running in multiple interpreter mode *** Jun 17 12:50:39.299869 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: spawned uWSGI master process (pid: 134339) Jun 17 12:50:39.300092 dv-cinder-846172-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 12:50:39.301144 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: spawned uWSGI worker 1 (pid: 134351, cores: 1) Jun 17 12:50:39.302401 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: spawned uWSGI worker 2 (pid: 134352, cores: 1) Jun 17 12:50:39.302401 dv-cinder-846172-2-iscsi devstack@n-api.service[134339]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 12:50:39.958934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:50:39.959559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:50:41.203995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:50:41.203995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: from cryptography.utils import int_from_bytes Jun 17 12:50:41.204685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:50:41.204685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: from cryptography.utils import int_from_bytes Jun 17 12:50:41.226237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:50:41.226237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: from cryptography.utils import int_from_bytes Jun 17 12:50:41.226824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:50:41.226824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: from cryptography.utils import int_from_bytes Jun 17 12:50:43.615697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:50:43.616273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:50:43.616474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:50:43.616837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:50:43.617091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:50:43.617479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.617801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.618119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.618428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.618752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.619051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.619395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.619710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.620032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.620289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.620601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.620929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-2-iscsi {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.621236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.621534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.621842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.622154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.622454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.622772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.623056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.623575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.624302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.624610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.624923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.625261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.625578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.625884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.626203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.626512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.626837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.627149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.627579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-2-iscsi {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.627898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.628225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.628525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.628998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.629314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.629618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.629941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.630269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.630575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.630901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.631218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.631560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.631881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.632229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.632536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.632842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.633208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.633510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.634033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.634275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.634706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.635031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.635355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.635703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.635952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.636200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.636517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.636840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.637148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.637453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.637759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.638065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.638371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.638673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.638975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.639278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.639627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.639937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.640255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.640607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.640924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.641366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.641616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.641922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.642308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.642627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.642934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.643297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.643644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.643950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.644298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.644655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.645010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.645347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.645721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.645969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.646269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.646578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.646894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.647199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.647533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.647838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.648138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.648442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.648748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.649053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.649359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.649681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.649973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.650276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.650578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.650879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.651195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.651546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.651853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.652157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.652470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.652768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.653087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.653507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.653818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.654136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.654442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.654747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.655062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.655384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.655695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.656012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.656311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.656622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.656937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.657241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.657544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.657848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.658149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.658450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.658751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.659050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.659350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.659668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.659988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.660354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.660663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.660970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.661274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.661591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.661924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.662254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.662595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.662909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.663239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.663593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.663911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.664223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.664534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.664857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.665165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.665476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.665784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.666099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.666571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.666905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.667277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.667611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.667930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.668241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.668556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.668884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.669204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.669513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.669850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.670194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.670503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.670824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.671146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.672366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.672366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.672366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.672366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.672750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.672983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.673297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.673607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.673912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.674218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.674526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.674832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.675163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.675544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.675882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.676202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.676813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.676813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.677082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.677383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.677683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.677983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.678345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.678652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.678953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.679271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.679620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.679926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.680257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.680557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.680864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.681171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.681476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.681777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.682086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.682391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.682692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.682861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:50:43.683271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.683387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:50:43.683502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.683609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.683696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:50:43.683933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.684027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:50:43.684236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.684389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:50:43.684536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.684637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.684844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.684944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.685149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.685257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.685458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.685558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.685764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.685865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.686070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.686165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.686387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.686488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.686702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.686804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.687010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.687105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.687311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.687483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.687653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.687748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.687967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.688067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-2-iscsi {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.688281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.688385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.688584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.688686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.688892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.689001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.689192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.689284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.689492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.689595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.689795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.689896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.690096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.690190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.690397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.690592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.690702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.690900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.691001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.691202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.691418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.691592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.691735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.691930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.692137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.692279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.692446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.692581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.692768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.692869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.693077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.693170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.693384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.693488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.693688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.693789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.693994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.694102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-2-iscsi {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.694366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.694493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.694645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.694900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.695082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.695211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.695302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.695415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.695635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.695741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.695957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.696052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.696267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.696358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.696578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.696677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.696893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.696996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.697202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.697295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.697513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.697614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.697824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.697925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.698141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.698241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.698439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.698541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.698746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.698847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.699051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.699142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.699406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.699528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.699696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.699801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.699990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.700084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.700241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.700334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.700548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.700650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.700866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.700975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.701189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.701291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.701507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.701611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.701758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.701861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.702008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.702167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.702325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.702422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.702642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.702788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.702949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.703102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.703256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.703360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.703586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.703730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.703883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.704052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.704182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.704365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.704503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.704701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.704819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.705067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.705187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.705382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.705510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.705694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.705828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.706012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.706133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.706314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.706432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.706630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.706763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.706987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.707186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.707318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.707491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.707648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.707853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.707968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.708088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.708264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.708383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.708573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.708704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.708879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.709000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.709189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.709308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.709492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.709625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.709790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.709909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.710094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.710233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.710751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.710888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.711080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.711175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.711398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.711509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.711652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.711787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.711941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.712209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.712300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.712518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.712661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.712823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.712958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.713130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.713214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.713436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.713541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.713738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.713840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.714042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.714139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.714353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.714449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.714682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.714826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.714962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.715063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.715270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.715385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.715600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.715707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.715907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.716210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.716414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.716576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.716801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.716903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.717114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.717417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.717523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.717722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.717822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.718027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.718129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.718330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.718431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.718647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.718745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.718951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.719052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.719253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.719353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.719595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.719747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.719902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.720120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.720283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.720431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.720537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.720798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.720891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.721102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.721421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.721560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.721716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.721891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.722289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.722437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.722661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.722872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.723027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.723196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.723343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.723565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.723728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.723875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.724023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.724174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.724323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.724469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.724610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.724757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.724915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.725060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.725153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.725337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.725442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.725654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.725763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.725975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.726070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.726285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.726591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.726695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.726895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.726990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.727214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:50:43.727308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.727571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.727684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.727893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.727986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.728212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.728304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.728534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.728640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.728859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.728951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.729187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.729282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.729496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.729598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.729808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.729899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.730118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.730219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.730416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.730510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.730724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.730826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.731028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.731121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.731330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.731445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.731664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.731756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.731973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.732076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.732276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.732377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.732576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.732672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.732876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.733002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.733179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.733282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.733489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.733594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.733790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.733883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.734099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.734189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.734400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.734500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.734715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.734815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.735019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.735153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.735320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.735451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.735702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.735818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.736019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.736111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.736338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.736521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.736649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.736752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.736957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.737057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.737265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.737358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.737583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.737684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.737910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.738008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.738229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.738398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.738572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.738676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.738880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.739032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.739191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.739470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.739581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.739781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.739873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.740090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.740192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.740400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.740492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.740702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.740805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.741013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.741117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.741320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.741414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.741630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.741731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.741937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.742037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.742235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.742325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.742538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.742668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.742836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.742928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.743136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.743278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.743459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.743567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.743760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.743852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.744059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.744151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.744364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.744464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.744668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.744760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.744970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.745069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.745277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.745383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.745577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.745678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.745888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.745991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.746199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.746307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.746506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.746607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.746810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.746939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.747118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.747247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.747483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.747643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.747801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.747949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.748108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.748253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.748404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.748549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.748701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.748846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.749005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.749162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.749305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.749458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.749602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.749745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.749897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.750058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.750204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.750347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.750609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.750769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.750931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.751080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.751246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.751417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.751417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.751709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.751709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.752091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.752235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.752380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.752380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.752664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.752809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.752952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.753095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.753259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.753413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.753572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.753572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.753893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.754044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.754044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.754350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.754522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.754689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.754859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.754991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.755130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.755236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.755361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.755534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.755656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.755844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.755938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.756143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.756237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.756444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.756538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.756746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.756850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.757047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.757141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.757363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.757459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.757670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.757774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.757969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.758070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.758267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.758360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.758567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.758675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.758903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.759005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.759202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.759295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.759553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.759665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.759865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.759958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.760184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.760276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.760481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.760624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.760783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.760877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.761093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.761193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.761399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.761491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.761705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.761796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.762015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.762119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.762322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.762426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.762635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.762729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.762936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.763036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.763243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.763414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.763579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.763701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.763887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.764014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.764195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.764316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.764502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.764597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.764803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.764939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.765109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.765210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.765418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.765520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.765728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.765830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.766036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.766138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.766340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.766441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.766648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.766756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.766954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.767055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.767258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.767350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.767590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.767772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.767898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.767999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.768197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.768297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.768511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.768615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.768821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.768923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.769133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.769227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.769435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.769617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.769837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.769984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.770144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.770335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.770459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.770646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.770764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.770952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.771075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.771264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.771418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.771604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.771739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.771918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.772057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.772227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.772338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.772528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.772629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.772940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.773040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.773270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.773406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.773552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.773693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.773855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.773957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.774162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.774264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.774471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.774577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.774779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.774874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.775092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.775231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.775418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.775536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.775718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.775844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.776144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.776466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.776608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.779391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.779522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.779629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.779710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.779710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.779844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.779924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.780864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.781183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.781343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.781650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.781786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.781948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.782105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.782215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.782294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.782556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.782662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.782932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.783030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.783180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.783306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.783562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.783668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.783765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.783989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.784087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.784208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.784465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.784561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.784713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.784840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.785019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.785192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.785382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.785710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.785954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.785954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.786113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.786301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.786406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.786587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.786713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.786896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.787033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.787204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.787343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.787507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.787648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.788346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.788452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.788546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.788621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.788621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.788748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.788825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.789184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.789296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.789371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.789453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.789630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.789768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.789949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.790075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.790263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.790406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.790591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.790717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.790916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.791042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.791217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.791346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.791577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.795502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.795596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.795672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.795672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.795820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.795896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.796937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.797102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.797271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.797425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.797598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.797759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.797912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.798064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.798216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.798369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.798536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.798689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.798853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.799014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.799176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.799341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.799529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.799712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.799870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.800032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.800186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.800354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.800516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.800676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.801217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.801420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.801613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.801810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.801994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.802186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.802349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.802505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.802665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.802832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.802987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.803138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.803290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.803489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.803670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.803831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.803984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.804134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.804287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.804437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.804624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.805181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.805334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.805487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.805658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.805918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.806101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.806264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.806417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.806663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.806831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.806984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.807146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.807307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.807307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.807682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.807846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.808014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.808166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.808330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.808491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.808643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.808796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.808958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.809119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.809279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.809430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.809582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.809741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.809975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.810142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.810296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.810467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.810628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.810779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.810947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.811100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.811260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.811457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.811632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.811800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.811956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.812107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.812265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.812427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.812587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.812752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.812905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.813074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.813235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.813395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.813548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.813708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.813708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.814009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.814161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.814320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.814482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.814644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.814813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.815350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.815548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.815702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.815869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.816134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.816294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.816447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.816598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.816841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.817010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.817010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.817325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.817478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.817639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.817791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.817957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.818110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.818264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.818416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.818575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.818736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.818919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.819095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.819273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.819458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.819633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.819797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.819960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.820115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.820268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.820428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.820591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.820752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.820905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.821055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.821217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.821380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.821540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.821703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.821856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.822017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.822170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.822332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.822486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.822647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.822799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.822951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.823145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.823328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.823328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.823663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.823820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.823972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.823972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.824334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.824492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.824645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.824797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.825381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.825565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.825734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.825889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.826041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.826291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.826460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.826630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.826807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.827030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.827198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.827352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.827561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.827718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.827882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.828049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.828202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.828362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.828531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.828694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.828846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.829006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.829168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.829321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.829487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.829648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.829809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.829980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.830141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.830303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.830471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.830471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.830771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.830924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.831253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.831484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.831662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.831820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.831972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.832293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.832476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.832645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.832808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.832963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.833114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.833265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.833425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.833659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.833814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.833967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.834127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.834308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.834583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.834766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.834930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.835104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.836047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.836471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.836647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.836802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.837164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.837340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.837497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.837649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.837821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.838047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.838217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.838380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.838380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.838670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.838838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.838991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.839153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.839305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.839512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.839674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.839837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.839989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.840152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.840306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.840456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.840617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.840778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.840931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.841091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.841252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.841411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.841578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.841741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.841902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.842065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.842216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.842366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.842526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.842678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.842839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.843000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.843160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.843312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.843547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.843710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.843864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.844024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.844188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.844355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.844509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.844670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.844822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.844984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.845135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.845449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.845615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.846031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.846196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.846358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.846618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.846805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.846961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.847158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.847415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.847593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.847748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.847912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.848065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.848217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.848376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.848528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.848697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.848697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.849036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.849203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.849358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.849517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.849681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.849846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.850019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.850178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.850338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.850492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.850660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.850823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.850988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.851149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.851300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.851487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.851658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.851817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.851969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.852129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.852281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.852447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.852609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.852763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.852923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.853087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.853248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.853416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.853570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.853721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.853874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.853874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.854169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.854338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.854501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.854653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.854812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.854972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.855145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.855313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.855668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.855828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.856264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.856424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.856664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.856909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.857069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.857221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.857390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.857616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.857800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.857963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.858124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.858277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.858437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.858597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.858763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.858917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.859078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.859232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.859403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.859574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.859738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.859903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.859903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.860194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.860355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.860517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.860669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.860821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.860980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.861132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.861284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.861446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.861604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.861770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.861935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.862087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.862247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.862411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.862563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.862715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.862874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.863026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.863192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.863457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.863618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.863770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.863933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.864098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.864267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.864421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.864581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.864742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.864902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.865188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.865378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.865536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.865854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.866022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.866480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.866741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.866915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.867175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.867336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.867336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.867935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.868100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.868262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.868422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.868586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.868740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.868902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.868902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.869217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.869217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.869661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.869816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.869969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.870131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.870292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.870454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.870608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.870766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.870934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.871102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.871274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.871471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.871644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.871812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.871980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.872133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.872284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.872435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.872588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.872748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.872911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.873071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.873246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.873531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.873703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.873868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.874030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.874190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.874343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.874495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.874647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.874813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.874966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.875119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.875271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.875472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.875637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.876020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.876191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.876655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.876814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.876969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.877121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.877393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.877554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.877707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.877948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.878108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.878284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.878445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.878611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.878764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.878951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.879117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.879279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.879490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.879647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.879943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.880104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.880269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.880433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.880598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.880757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.880918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.881080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.881232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.881396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.881618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.881783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.881946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.882099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.882259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.882426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.882589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.882754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.882754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.883043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.883207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.883384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.883556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.883718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.883879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.884031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.884233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.884397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.884562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.884726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.884879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.885037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.885205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.885368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.885542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.885703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.885857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.886207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.886370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.886870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.887042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.887250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.887578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.887757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.887940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.888164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.888323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.888477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.888631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.888798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.888961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.889114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.889284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.889577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.889772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.889954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.890181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.890346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.890505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.890666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.890835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.890988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.891148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.891309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.891538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.891715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.891882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.892035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.892195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.892357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.892510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.892673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.892835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.892989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.893152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.893306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.893466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.893629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.893794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.893947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.894099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.894252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.894440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.894800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.894972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.895153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.895431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.895594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.895769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.895933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.896118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.896440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.896602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.897096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.897274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.897438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.897618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.897618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.898821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.900235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.901479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.902696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.903907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.906245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.908103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.909269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.910754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.911944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.913105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.914273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.915439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.916968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.918570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.918570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.918570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.918570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.918570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.918570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.918570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.919676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.919676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.919676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.920116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.920116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.920413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.920631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.920971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.921177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.921505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.921802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.922131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.922454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.922761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.923758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.924129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.924489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.924832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.925179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.925507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.925891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.926223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.926558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.926932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.927248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.927764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.927939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.928198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.928518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.928854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.929187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.929502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.929835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.930163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.930488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.930811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.931133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.931496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.931814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.932133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.932452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.932765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.933082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.933404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.933722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.934055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.934384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.934748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.935084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.935443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.935799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.936114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.936461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.936790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.937092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.937410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.937855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:50:43.938025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:50:43.942646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO dbcounter [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Registered counter for database nova_api Jun 17 12:50:43.964174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_db.sqlalchemy.engines [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:43.971778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writer thread running {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.002158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO dbcounter [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Registered counter for database nova_api Jun 17 12:50:44.022814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_db.sqlalchemy.engines [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:44.029512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writer thread running {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.030605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.context [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8(cell1) {{(pid=134352) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:50:44.034790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:50:44.036440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:50:44.037253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:50:44.039203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:50:44.041256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO dbcounter [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Registered counter for database nova_cell0 Jun 17 12:50:44.045183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO dbcounter [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Registered counter for database nova_cell1 Jun 17 12:50:44.053034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_db.sqlalchemy.engines [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:44.054930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_db.sqlalchemy.engines [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:44.060717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writer thread running {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.063395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writer thread running {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.087678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.context [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8(cell1) {{(pid=134351) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:50:44.091865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:50:44.093449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:50:44.094337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:50:44.096294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:50:44.098385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO dbcounter [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Registered counter for database nova_cell0 Jun 17 12:50:44.102252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO dbcounter [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Registered counter for database nova_cell1 Jun 17 12:50:44.113453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_db.sqlalchemy.engines [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:44.113453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_db.sqlalchemy.engines [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:44.116933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writer thread running {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.210912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO dbcounter [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Registered counter for database nova_cell0 Jun 17 12:50:44.217881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_db.sqlalchemy.engines [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:44.222827 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writer thread running {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.258535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writer thread running {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.268662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO dbcounter [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Registered counter for database nova_cell0 Jun 17 12:50:44.276088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_db.sqlalchemy.engines [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:50:44.281024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writer thread running {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:50:44.538716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: WARNING keystonemiddleware.auth_token [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:50:44.546016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: WARNING keystonemiddleware.auth_token [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:50:44.596615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: WARNING keystonemiddleware.auth_token [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:50:44.603985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: WARNING keystonemiddleware.auth_token [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:50:44.893150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: WARNING keystonemiddleware.auth_token [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:50:44.899283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: WARNING keystonemiddleware.auth_token [None req-0ddebb65-b78c-47b2-9b1a-9beb9fb4ae32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:50:44.904815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab9822d9c0 pid: 134352 (default app) Jun 17 12:50:44.948076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: WARNING keystonemiddleware.auth_token [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:50:44.954198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: WARNING keystonemiddleware.auth_token [None req-0607ebf6-0e96-453e-88f2-1cff588675ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:50:44.959664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab9822d9c0 pid: 134351 (default app) Jun 17 12:51:28.534756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e0ffa6d6-5e6c-47fc-be7d-eab58c34ebd1 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455125ca60>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:28.578346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=3 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:28.579497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=3 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:28.581623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=3 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:28.583026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=3 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:29.071813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e0ffa6d6-5e6c-47fc-be7d-eab58c34ebd1 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/10dcef8c-76c3-42e9-90e5-fcbc59899703" status: 200 len: 351 microversion: 2.1 time: 0.897673 Jun 17 12:51:29.073278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1/1] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 12:51:28 2022] GET /compute/v2.1/os-volumes/10dcef8c-76c3-42e9-90e5-fcbc59899703 => generated 351 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:30.828465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:30.829328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:30.830274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:30.833365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:31.290080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f63598fd-1119-4f70-b4a5-db8092e09953 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f45508a7310>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:32.292069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f63598fd-1119-4f70-b4a5-db8092e09953 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/9e1f42cb-92cc-407e-9780-9d5885ba1dea" status: 200 len: 350 microversion: 2.1 time: 1.469345 Jun 17 12:51:32.292917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1/2] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 12:51:30 2022] GET /compute/v2.1/os-volumes/9e1f42cb-92cc-407e-9780-9d5885ba1dea => generated 350 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:36.354284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-667d58b2-ed65-4b03-afaa-14fa18517230 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455075f670>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:36.481010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-667d58b2-ed65-4b03-afaa-14fa18517230 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/b6e5dd5a-608a-44a7-82e0-c82aa5d546d7" status: 200 len: 350 microversion: 2.1 time: 0.136660 Jun 17 12:51:36.481867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2/3] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 12:51:36 2022] GET /compute/v2.1/os-volumes/b6e5dd5a-608a-44a7-82e0-c82aa5d546d7 => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:36.505841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b6986717-3946-48e2-8d76-bc370f573da9 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455076e550>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:36.640542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b6986717-3946-48e2-8d76-bc370f573da9 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.150338 Jun 17 12:51:36.641630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2/4] 10.222.0.87 () {58 vars in 1133 bytes} [Fri Jun 17 12:51:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:36.657692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de59ef4c-3b22-4d15-b128-576ec265109e tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455075f820>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:36.867321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-de59ef4c-3b22-4d15-b128-576ec265109e tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.214702 Jun 17 12:51:36.868405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 3/5] 10.222.0.87 () {58 vars in 1148 bytes} [Fri Jun 17 12:51:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:36.883426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cd2b3a0a-4b3c-4ad0-a24c-95e90c2b78a5 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455076ed30>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:37.076766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cd2b3a0a-4b3c-4ad0-a24c-95e90c2b78a5 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.197397 Jun 17 12:51:37.077887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 3/6] 10.222.0.87 () {58 vars in 1133 bytes} [Fri Jun 17 12:51:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:37.099632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b2ba4c94-bae4-4fd3-b9fe-c8c74ce9b98f tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455072e310>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:37.344095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b2ba4c94-bae4-4fd3-b9fe-c8c74ce9b98f tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.253510 Jun 17 12:51:37.346518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 4/7] 10.222.0.87 () {58 vars in 1166 bytes} [Fri Jun 17 12:51:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:37.360381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b47d575d-b260-4804-9b01-86df6404c9be tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f45507311f0>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:37.554764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b47d575d-b260-4804-9b01-86df6404c9be tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.199115 Jun 17 12:51:37.556820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 4/8] 10.222.0.87 () {58 vars in 1169 bytes} [Fri Jun 17 12:51:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:37.572158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2fe3c6da-aa5a-41ab-96e9-a9e13f653a41 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455075fe50>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:37.778048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2fe3c6da-aa5a-41ab-96e9-a9e13f653a41 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.211012 Jun 17 12:51:37.778903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 5/9] 10.222.0.87 () {58 vars in 1154 bytes} [Fri Jun 17 12:51:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:37.790351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8c02a68d-5218-471a-bd15-60c274c44514 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f4550731e50>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:37.919177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8c02a68d-5218-471a-bd15-60c274c44514 tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.132987 Jun 17 12:51:37.933431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-adbb3e5f-c973-474f-9e87-986d7506953a tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] Calling method '.version_select at 0x7f455072e550>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:37.934094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 5/10] 10.222.0.87 () {58 vars in 1187 bytes} [Fri Jun 17 12:51:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:38.044580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-adbb3e5f-c973-474f-9e87-986d7506953a tempest-VolumesTestJSON-1515094339 tempest-VolumesTestJSON-1515094339-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.114922 Jun 17 12:51:38.057241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 6/11] 10.222.0.87 () {58 vars in 1154 bytes} [Fri Jun 17 12:51:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:40.037023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-772297c5-8ef4-44b7-b2e1-e0fef82c154c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: .version_select at 0x7f4550731430>, body: {"keypair": {"name": "tempest-keypair-1312277092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYJrb2iKcQkamHRzR341qfDjBY/2RMeCrmPWplamQuCTqKuowSyLWscciflvqhSjGAoUP6HszbbIM9CsukjgG7CpFeYqFSXXsOIXf3CRHgTt0pdJfau+7rx74lUdu6wrg=="}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:40.170601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-772297c5-8ef4-44b7-b2e1-e0fef82c154c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:40.190844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-772297c5-8ef4-44b7-b2e1-e0fef82c154c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:40.325468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-772297c5-8ef4-44b7-b2e1-e0fef82c154c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.422727 Jun 17 12:51:40.326183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 6/12] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 12:51:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:43.735262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-75797e41-6bb4-407c-a7a8-1cf1aa2b593f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'create', calling method: .version_select at 0x7f455075f820>, body: {"keypair": {"name": "tempest-keypair-1401143179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBTZrLoPK198W1UGY4KsiS5dS/c/hlZJ4zldvpZeZ2OXrI1rlRCQhl3Row8u/B2Iqok1mP+xcufYxfhncbXkOCglDTs9gSAgeIlHJqxZX4xkgz5A/hBctiPU3sKWzCbuA=="}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:43.802568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-80864971", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:43.879253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-75797e41-6bb4-407c-a7a8-1cf1aa2b593f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:43.902226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-75797e41-6bb4-407c-a7a8-1cf1aa2b593f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for user a14c1230233e43789087e9239ffb91e2 and project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:43.996625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-75797e41-6bb4-407c-a7a8-1cf1aa2b593f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.529632 Jun 17 12:51:43.999598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 7/13] 10.222.0.87 () {62 vars in 1199 bytes} [Fri Jun 17 12:51:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 533 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 12:51:44.015419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] validate_networks() for [('8c808cce-5566-4c2e-aca7-558956794d91', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:51:46.803324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:51:46.805144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:51:46.806069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:51:46.807315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:51:46.807927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:51:46.835627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:46.838579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:46.843351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:46.844718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:46.946636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for project 8ba886227347427bb1cbce939509be05. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:46.966096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for user efee42b434cd47d99984b85f677983c2 and project 8ba886227347427bb1cbce939509be05. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:47.016949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:51:47.025492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:51:47.224782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f303d325-02f5-45fb-a187-68baca487e3a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.572447 Jun 17 12:51:47.231554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 7/14] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:51:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:51:47.236680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-68e83ac1-2f26-4a2b-96aa-a02d78c69c14 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:47.238254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-68e83ac1-2f26-4a2b-96aa-a02d78c69c14 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:48.361094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-68e83ac1-2f26-4a2b-96aa-a02d78c69c14 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:48.394205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-68e83ac1-2f26-4a2b-96aa-a02d78c69c14 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1220 microversion: 2.1 time: 1.161582 Jun 17 12:51:48.404757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 8/15] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:47 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1220 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:51:48.952859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-687119263", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:49.041233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] validate_networks() for [('8c808cce-5566-4c2e-aca7-558956794d91', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:51:50.102873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ca1bc9ba-702e-4d4f-85ce-7732f889e0d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'create', calling method: .version_select at 0x7f45506c4d30>, body: {"keypair": {"name": "tempest-keypair-238307170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd6Zyg9hxO3RI+UU/e7X8LDFmqbMLZ8UjC4Jgtb8R+VYqCpA0tHZrFVGN+02xsnToMXcqIDhaLFn1weNkZOdDZ4Z6ZYJjdmnoMIHnMavHAhbqGMqsVmwkf6XDwj5Kiklw=="}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:50.149167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-ca1bc9ba-702e-4d4f-85ce-7732f889e0d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:50.166500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-ca1bc9ba-702e-4d4f-85ce-7732f889e0d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for user f3bfb04b34ed4761bb09be7b29d1ec8f and project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:50.250687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ca1bc9ba-702e-4d4f-85ce-7732f889e0d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.700352 Jun 17 12:51:50.251312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 9/16] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 12:51:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:50.269126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-345071649", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63451fcb-248d-4063-92cc-62a9c2c4e98f"}], "security_groups": [{"name": "tempest-securitygroup--537013665"}], "key_name": "tempest-keypair-1312277092", "user_data": "}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:50.393322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:51:50.395345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:51:50.396005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:51:50.396952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:51:50.397686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:51:50.413629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:50.414340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:50.415313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:50.415940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:50.442552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for project 8ba886227347427bb1cbce939509be05. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:50.460808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for user efee42b434cd47d99984b85f677983c2 and project 8ba886227347427bb1cbce939509be05. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:50.478257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:51:50.481152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:51:50.603752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9a69c7b1-7584-45c8-936c-49947dba9109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.660380 Jun 17 12:51:50.606142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 8/17] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:51:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:51:50.730030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] validate_networks() for [('63451fcb-248d-4063-92cc-62a9c2c4e98f', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:51:50.993299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-446701952", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "networks": [{"uuid": "e769ab49-4727-4bda-93f6-889ae956c57c"}]}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:51.140095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] validate_networks() for [('e769ab49-4727-4bda-93f6-889ae956c57c', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:51:53.725176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:51:53.726275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:51:53.726896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:51:53.728178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:51:53.728754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:51:53.762082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:53.762537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:53.763333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:53.763798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:53.817816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Getting quotas for project 652fca4387ef47078860b964334a8651. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:53.838711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Getting quotas for user a17b8a752d78431dbde11be6d0812de3 and project 652fca4387ef47078860b964334a8651. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:53.877818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:51:53.881878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:51:54.053016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc1c7a2e-c180-424a-b875-d63d37b58322 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.445501 Jun 17 12:51:54.053701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 9/18] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:51:54.081591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1937699951", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be305ded-f559-45bc-94a4-3366ddb58607"}], "security_groups": [{"name": "tempest-securitygroup--154994231"}], "key_name": "tempest-keypair-1401143179", "user_data": "}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:54.408217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:51:54.422777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:51:54.423599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:51:54.426595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:51:54.427319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:51:54.453846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] validate_networks() for [('be305ded-f559-45bc-94a4-3366ddb58607', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:51:54.466037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:54.466497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:54.475296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:54.479148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:54.594155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:54.635261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:54.668820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:51:54.680190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:51:54.959188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c1808d2b-b420-4644-963f-a1ffb506474b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.703610 Jun 17 12:51:54.960383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 10/19] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:51:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 4709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:51:54.975081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:54.976025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:54.991851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:54.995311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:54.996612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:54.997261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:55.351120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:55.381789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-14110eb2-e7ff-4df4-8b2d-ba8f0c1a3067 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1225 microversion: 2.1 time: 0.411083 Jun 17 12:51:55.385807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 11/20] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:54 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1225 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:55.395285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:55.397409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:55.407125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:55.416646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:55.418398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:55.419043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:55.682291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:55.693661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b19643e1-19d7-46cc-b73d-786f9fe8cd4f tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1218 microversion: 2.1 time: 0.306645 Jun 17 12:51:55.701142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 12/21] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:55 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1218 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:55.711542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef861657-8110-4c80-961b-45803dd5ad85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:55.714571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef861657-8110-4c80-961b-45803dd5ad85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:55.757371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:51:55.758543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:51:55.759311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:51:55.760074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:51:55.760833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:51:55.784385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:55.796077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:55.799443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:55.801609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:55.866655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:51:55.880457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for user a14c1230233e43789087e9239ffb91e2 and project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:51:55.922170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:51:55.926204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef861657-8110-4c80-961b-45803dd5ad85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:55.931230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:51:55.939067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef861657-8110-4c80-961b-45803dd5ad85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1241 microversion: 2.1 time: 0.236145 Jun 17 12:51:55.948536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 13/22] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1241 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:56.129176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ba71794d-91f5-46d1-9aff-955c42676c0d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.065185 Jun 17 12:51:56.136542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 10/23] 10.222.0.87 () {62 vars in 1187 bytes} [Fri Jun 17 12:51:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 12:51:56.146320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-52dbbeaf-74b4-4b5b-b0cb-34df5088db4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:56.147316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-52dbbeaf-74b4-4b5b-b0cb-34df5088db4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:56.419520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:56.421354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:56.520344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-52dbbeaf-74b4-4b5b-b0cb-34df5088db4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:56.535785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:56.536992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-52dbbeaf-74b4-4b5b-b0cb-34df5088db4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:56.538538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-52dbbeaf-74b4-4b5b-b0cb-34df5088db4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:56.545841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:56.546585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-52dbbeaf-74b4-4b5b-b0cb-34df5088db4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1282 microversion: 2.20 time: 0.398460 Jun 17 12:51:56.546701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:56.548551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 14/24] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:51:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1282 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:51:56.555731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:56.723728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:56.729173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:56.738548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:56.751239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:56.754759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:56.755291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:57.592586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:57.608246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-978c00e2-02d3-479f-bd88-27e0707a768d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1266 microversion: 2.1 time: 0.893412 Jun 17 12:51:57.608999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 15/25] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:56 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1266 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:51:57.626488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:57.632341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:57.648649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:57.652496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:57.654683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:57.659877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:57.686260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:57.766736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-621ba1be-ce24-4ffe-89aa-aaec82473b2a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1273 microversion: 2.1 time: 1.359373 Jun 17 12:51:57.770252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 11/26] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:56 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1273 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:57.810793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2126144158", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64b59cbb-49d9-45bc-827b-795881902e72"}], "security_groups": [{"name": "tempest-securitygroup--848589675"}], "key_name": "tempest-keypair-238307170", "user_data": "}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:51:57.819268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:57.827817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0dda17c3-dc08-40eb-9ab8-041907b4c1ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1293 microversion: 2.1 time: 0.216444 Jun 17 12:51:57.832432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 16/27] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1293 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:57.839095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:57.845067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:57.861014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:57.861798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:57.863119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:57.863978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:57.972191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:57.981935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:57.987448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:57.991187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3450db9c-b184-4ce5-af29-6a83db2102cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1286 microversion: 2.20 time: 0.157299 Jun 17 12:51:57.993203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 17/28] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:51:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:51:58.626016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:58.626718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:58.634806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:58.635259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:58.636067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:58.641812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.092584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] validate_networks() for [('64b59cbb-49d9-45bc-827b-795881902e72', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:51:59.201705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:59.222837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-680051e3-d004-45ba-a683-5a82139fb46d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.600512 Jun 17 12:51:59.223467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 18/29] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:58 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:51:59.228420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:59.232654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:59.251550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.252021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.253262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.253700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.470342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:59.480867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be6633b4-a0a6-4aa1-8273-720ab4254b48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1279 microversion: 2.1 time: 0.256136 Jun 17 12:51:59.493674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 19/30] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:59 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1279 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:59.504932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:59.506951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:59.517288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.527457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.528662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.533997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.692961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:59.708349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-62c51fab-b331-4f3c-ab71-c54357d3f454 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1301 microversion: 2.1 time: 0.210960 Jun 17 12:51:59.708940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 20/31] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:51:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1301 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:59.714429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:59.716937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:51:59.739088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.739569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.740334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.740745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.844221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:59.855675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:59.857345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:51:59.858554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8e2be2c2-a12b-4039-a3cc-aaa0b5c2b582 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.148504 Jun 17 12:51:59.859543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 21/32] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:51:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:51:59.983780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:51:59.985037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:51:59.985656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:51:59.986523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:51:59.987203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:51:59.996755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.997796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:51:59.998711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:51:59.999332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.019405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:52:00.023879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for user f3bfb04b34ed4761bb09be7b29d1ec8f and project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:52:00.039333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:52:00.043423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:52:00.104673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad1aafac-1976-4906-84b1-9571e697d824 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.330627 Jun 17 12:52:00.112220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 12/33] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:51:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:52:00.127903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-925291ba-ac48-4052-b658-dce6da29d943 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:00.129187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-925291ba-ac48-4052-b658-dce6da29d943 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:00.217729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-20addd7b-560d-45ab-b07c-d3ecece01877 req-c88894ad-1e88-4798-85b8-f49f1d74a0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d77c9b-4a5f-469d-9a72-ced7b26a4138", "tag": "d72f5648-68ed-4330-b798-01859fad53c5"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:00.226889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-925291ba-ac48-4052-b658-dce6da29d943 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:00.241827 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-925291ba-ac48-4052-b658-dce6da29d943 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1237 microversion: 2.1 time: 0.128467 Jun 17 12:52:00.251305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:00.255587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 22/34] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1237 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:00.265999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:00.266611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:00.273047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-20addd7b-560d-45ab-b07c-d3ecece01877 req-c88894ad-1e88-4798-85b8-f49f1d74a0cf service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.276544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-20addd7b-560d-45ab-b07c-d3ecece01877 req-c88894ad-1e88-4798-85b8-f49f1d74a0cf service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.282695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.283538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.284326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.284764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.334427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-20addd7b-560d-45ab-b07c-d3ecece01877 req-c88894ad-1e88-4798-85b8-f49f1d74a0cf service nova] Creating event network-changed:d72f5648-68ed-4330-b798-01859fad53c5 for instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 on hv-cinder-84617 Jun 17 12:52:00.335311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-20addd7b-560d-45ab-b07c-d3ecece01877 req-c88894ad-1e88-4798-85b8-f49f1d74a0cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=134351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 12:52:00.336707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cb11a4f-68b8-48ad-8b69-8387920116a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.337397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cb11a4f-68b8-48ad-8b69-8387920116a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.338243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cb11a4f-68b8-48ad-8b69-8387920116a2 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.338755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cb11a4f-68b8-48ad-8b69-8387920116a2 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.350367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.compute.rpcapi [None req-1cb11a4f-68b8-48ad-8b69-8387920116a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 12:52:00.351442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cb11a4f-68b8-48ad-8b69-8387920116a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=134351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 12:52:00.378171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:00.380157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1cb11a4f-68b8-48ad-8b69-8387920116a2 None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231323 Jun 17 12:52:00.381232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 13/35] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:00.390142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2d95c8c-a84a-4ce2-a696-2c20b7edbd1e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.129532 Jun 17 12:52:00.390982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 23/36] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:00 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:00.503015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:00.503959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:00.512409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.513240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.514760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.515570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.680284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:00.690974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-32f2c016-1998-4913-ae6e-ad14a145605f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.192663 Jun 17 12:52:00.700951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 14/37] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:00 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:00.726029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:00.726638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:00.732970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.733417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.734172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.734602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.800281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:00.808270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c68b8271-18b4-4dd4-9fe2-090c2ed0b2cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.086076 Jun 17 12:52:00.808875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 24/38] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:00.878273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:00.878883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:00.885576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.886025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.886782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:00.887189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:00.956769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:00.966167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:00.969015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:00.972185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8e668bb5-cd3e-4d84-95d9-8999ac8b8a87 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.097153 Jun 17 12:52:00.977775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 15/39] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:01.262878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:01.263733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:01.272305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.272894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.273897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.274474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.353458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:01.363181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-32086a37-f22e-43f8-93d1-7ee2582f87f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1241 microversion: 2.1 time: 0.105999 Jun 17 12:52:01.365665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 25/40] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:01.407703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:01.408308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:01.425329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.426033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.426890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.427448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.497559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:01.505497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-19630772-4abe-4704-bbbe-ce8a7653fdb1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.101928 Jun 17 12:52:01.506165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 16/41] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:01 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:01.707930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:01.708632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:01.715297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.716157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.716922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.717356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.826476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:01.827101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:01.833876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.834654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.835695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:01.836327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:01.880798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:01.888723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dbc06122-b341-4769-93b5-77d19ea0e622 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.184776 Jun 17 12:52:01.889305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 26/42] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:01 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:01.903848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:01.912416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c39307c3-4bb6-485f-8961-0c5cc30ef1c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.090659 Jun 17 12:52:01.912983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 17/43] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:01.994682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:01.995801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:02.002156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.002599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.003353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.003995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.088379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:02.099619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:02.101598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:02.103294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cb7b5cb6-d8cf-4401-9526-e377b8ec6779 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.113243 Jun 17 12:52:02.104457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 27/44] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:02.380801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:02.383438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:02.389438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.390540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.391782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.392426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.480670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:02.488570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-237a90b5-bf5c-4b8a-ae4e-5fb1849754d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1241 microversion: 2.1 time: 0.111618 Jun 17 12:52:02.489067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 18/45] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:02.524427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:02.525036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:02.532013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.532763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.534030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.534642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.618937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:02.629501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-99c84185-807c-43d0-8f9d-d15daf6d6443 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.109996 Jun 17 12:52:02.635851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 28/46] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:02 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:02.914320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:02.917970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:02.921488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.921938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.924467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.924467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.929765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:02.931913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:02.937427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.938080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:02.939083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:02.939923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:03.042938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:03.051874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9cf402d9-27f0-4053-8fae-319060aa1b78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.126033 Jun 17 12:52:03.061846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 29/47] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:03.127674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:03.128293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:03.136857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:03.137274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:03.138076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:03.138889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:03.144357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:03.163271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:03.174600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0b54fbbe-5a55-4fe5-b125-1da9267b8770 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.271021 Jun 17 12:52:03.175435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 19/48] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:02 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:03.245280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:03.253206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:03.254714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:03.255842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2e07d053-eb5e-4eb0-a4b9-dce1a3ecb08b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.132160 Jun 17 12:52:03.256597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 30/49] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:03.509110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:03.510320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:03.530399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:03.530771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:03.531627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:03.532091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:03.611716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:03.620450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd7cba01-951a-4f0e-b002-8703557e61e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1241 microversion: 2.1 time: 0.118413 Jun 17 12:52:03.621127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 20/50] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:03.646039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:03.646999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:03.654474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:03.655114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:03.655917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:03.656348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:03.733571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:03.742720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d1a92c6d-1bdf-4072-bc19-a4230e03f91a tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.100409 Jun 17 12:52:03.743488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 31/51] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:03 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:04.070064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:04.070683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:04.077570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.078029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.078794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.079405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.159196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:04.168040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-945bc7c1-97a9-4c08-bea6-bbe5474dee40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.102156 Jun 17 12:52:04.177695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 21/52] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:04.194586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:04.195185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:04.203343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.203987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.205180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.205620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.276203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:04.277252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:04.284617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.285298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.286469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.287151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.371147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:04.382334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:04.383906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:04.385049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b2be0bd8-2761-4f9a-adc9-f64a54163e78 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.114393 Jun 17 12:52:04.385858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 22/53] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:52:04.407782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:04.418020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0210b5aa-4c5d-4329-9ce0-3b0ee8e963e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.229258 Jun 17 12:52:04.418603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 32/54] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:04 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:04.638342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:04.638952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:04.645319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.645767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.646666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.647100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.723178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:04.732372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a5b3e37c-eb3e-4687-bc01-a71abe22995e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1241 microversion: 2.1 time: 0.098395 Jun 17 12:52:04.732972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 23/55] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:04.760930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:04.766892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:04.766892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:04.775255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.775847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.776679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:04.777107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:04.891387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:04.918005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b4e3109c-8fc8-4514-b97d-66a5236d5d76 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.160833 Jun 17 12:52:04.918701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 33/56] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:04 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:05.185349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:05.185995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:05.197035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.197900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.199470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.200001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.313862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:05.323327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df6200b2-5de0-4bac-bdce-8206810954b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.142346 Jun 17 12:52:05.324337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 24/57] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:05.404729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:05.405397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:05.408371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:05.411945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.412382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.413145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.413573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.440229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:05.440852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:05.448916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.449361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.450137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.450571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.484889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:05.494980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:05.497170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:05.498586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7117a6f4-5f95-4ace-bed3-0d42af6cb62f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.098378 Jun 17 12:52:05.499706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 34/58] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:05.613650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:05.626877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8682659a-623e-4d8e-8202-b62cb332862a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.192101 Jun 17 12:52:05.626877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 25/59] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:05 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:05.756533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:05.757147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:05.771578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.771578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.771807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.772246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.893096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:05.904768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aa8c4bc7-b1f9-4ae5-9ebd-5cc3fe4c1355 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1241 microversion: 2.1 time: 0.158004 Jun 17 12:52:05.905365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 35/60] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1241 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:05.935435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:05.936149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:05.943658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.944157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:05.945388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:05.946125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.024603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:06.037008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4d3c9cc1-0330-466d-ae9a-c852d3a285ae tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.102305 Jun 17 12:52:06.037712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 26/61] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:05 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:06.341359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:06.343404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:06.360840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.361299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.363489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.364332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.449992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:06.469219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2f1ec35c-756c-432c-a112-bc5ea66c43fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.132492 Jun 17 12:52:06.469877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 36/62] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:06.517667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:06.518527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:06.527334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.528228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.529396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.530004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.535480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:06.614804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:06.625388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:06.627681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:06.629092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aa2a418f-5e36-43c5-abc3-a7d8d254516d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.115805 Jun 17 12:52:06.631419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 27/63] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:06.651359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:06.657886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:06.672166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.673725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.679112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.679609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.830784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:06.851885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6a800187-3213-4577-802d-a69bce0f9746 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.215292 Jun 17 12:52:06.853622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 37/64] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:06 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:06.922700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:06.923308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:06.929309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.929753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:06.930500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:06.930926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.011803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:07.019948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6587bfde-5d11-4ba6-b169-d958c2c01ae0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1241 microversion: 2.1 time: 0.101135 Jun 17 12:52:07.020516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 28/65] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:07.055030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:07.056149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:07.063530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.064306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.065482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.066262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.150658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:07.158312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7aec87bb-575b-4ffc-a0c8-c9b91e3b79c9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.108053 Jun 17 12:52:07.158884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 38/66] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:07 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:07.486292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:07.486901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:07.492787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.493233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.493989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.494593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.568953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:07.579808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-84c76dbe-a245-4c37-9387-eb3311c6208f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.097282 Jun 17 12:52:07.591634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 29/67] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:07.650459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:07.651847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:07.659501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.660348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.661362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.662117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.747314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:07.755508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:07.757029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:07.758132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c0ea9e5-0bbc-4871-b196-9ed541559a20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.112650 Jun 17 12:52:07.758702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 39/68] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:07.870574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:07.875322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:07.887905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.891833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:07.895058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:07.895496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.037755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:08.038862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:08.046457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.047084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.047985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.048641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.084557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:08.093983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8da52895-4b7d-46a5-afa4-efa4e4f381b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.227640 Jun 17 12:52:08.095303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 30/69] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:07 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:08.136234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:08.144472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-028dbc07-2e03-43fe-bf3d-5d52892e48e8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1241 microversion: 2.1 time: 0.111066 Jun 17 12:52:08.145250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 40/70] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:08.175668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:08.176402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:08.182963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.183272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.184135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.184573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.258157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:08.265939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5428dc93-c0f5-4233-97f5-e86bef19428e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.094166 Jun 17 12:52:08.266593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 31/71] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:08 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:08.597195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:08.597798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:08.605043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.605477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.606300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.606721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.679239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:08.687427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e7367d09-3f27-4430-ae87-da3b1b14f3b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1311 microversion: 2.1 time: 0.093925 Jun 17 12:52:08.687939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 41/72] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:08.778175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:08.779259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:08.787534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.787945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.788875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:08.789462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:08.970174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:08.979334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:08.985617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:08.989601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0128c2da-b858-4f1a-b0c9-f0d7827e1918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1278 microversion: 2.20 time: 0.215603 Jun 17 12:52:08.992106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 32/73] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:09.114413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:09.115068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:09.127602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.128454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.129755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.130447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.161850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:09.162459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:09.181331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.181790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.182712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.183133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.593512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:09.608897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-49addd74-55c9-4cad-813f-3c7645a918ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1233 microversion: 2.1 time: 0.450787 Jun 17 12:52:09.619266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 33/74] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1233 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:09.634113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:09.635114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:09.645081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.650801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.651991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.652750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.796460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:09.806474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-80ef02cb-12c2-4694-81ef-5a13ce23c895 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.697101 Jun 17 12:52:09.816873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 42/75] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:09 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:09.822995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:09.823927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:09.833226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.836397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.837661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:09.840163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:09.936712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:09.949822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-717825f0-8a01-4929-85d5-ebc51413b975 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.328771 Jun 17 12:52:09.950677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 34/76] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:09 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:09.995358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:10.009440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:10.010180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:10.016597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:10.019244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-006e4db9-0d96-440a-aa47-36e863062906 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1299 microversion: 2.1 time: 0.200880 Jun 17 12:52:10.028888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 43/77] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:10.038149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:10.038149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:10.038149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:10.038149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=34 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:10.349484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:10.355792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=12 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:10.368620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:10.370648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:10.371893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eff70b8c-0c3d-472e-9ca4-0bd3e6cd25a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1340 microversion: 2.20 time: 0.366540 Jun 17 12:52:10.384319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 35/78] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1340 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:10.636702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:10.639847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:10.643049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=22 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:10.683046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:10.683610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:10.684434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:10.686795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:10.828382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:10.829428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:10.851844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:10.852333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:10.853147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:10.853579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.003838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:11.015478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1d3c648b-156b-4135-a084-3cfdd8f0d713 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1295 microversion: 2.1 time: 0.391080 Jun 17 12:52:11.017039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 44/79] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1295 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:11.025348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:11.030246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:11.045520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.046414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.047085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.047897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.177002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:11.190534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-edcbb601-efce-42dd-82ac-7e017fd9fbe6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1272 microversion: 2.1 time: 0.172371 Jun 17 12:52:11.201746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 45/80] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:11 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:11.281934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-23ace144-9332-451f-a69e-aa570513d3df req-fcb7f882-8781-4268-92ec-90b3aa9ea419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c79dff5-fa8d-4a6c-9097-833e4b9bfc70", "tag": "1ff34f55-6087-4fc6-8b79-f24499ec625a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:11.307442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-23ace144-9332-451f-a69e-aa570513d3df req-fcb7f882-8781-4268-92ec-90b3aa9ea419 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.308511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-23ace144-9332-451f-a69e-aa570513d3df req-fcb7f882-8781-4268-92ec-90b3aa9ea419 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.345196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-23ace144-9332-451f-a69e-aa570513d3df req-fcb7f882-8781-4268-92ec-90b3aa9ea419 service nova] Creating event network-changed:1ff34f55-6087-4fc6-8b79-f24499ec625a for instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 on hv-cinder-84617 Jun 17 12:52:11.346392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-23ace144-9332-451f-a69e-aa570513d3df req-fcb7f882-8781-4268-92ec-90b3aa9ea419 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 12:52:11.347744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28195fa3-3708-49b4-bc52-162273443f25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.348345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28195fa3-3708-49b4-bc52-162273443f25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.349278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28195fa3-3708-49b4-bc52-162273443f25 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.349852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28195fa3-3708-49b4-bc52-162273443f25 None None] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.361486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.compute.rpcapi [None req-28195fa3-3708-49b4-bc52-162273443f25 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 12:52:11.362609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28195fa3-3708-49b4-bc52-162273443f25 None None] Releasing lock "compute-rpcapi-router" {{(pid=134352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 12:52:11.379443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-28195fa3-3708-49b4-bc52-162273443f25 None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176036 Jun 17 12:52:11.380449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 46/81] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:11.385851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:11.386794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:11.393979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.394701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.395777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.396464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.403256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:11.487029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:11.496841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d8194ea1-fa5b-449e-8d17-f2f328b4fe90 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1299 microversion: 2.1 time: 0.114621 Jun 17 12:52:11.497781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 47/82] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:11.504847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:11.505708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:11.514518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.515561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.516523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:11.517093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:11.598128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:11.610118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:11.612613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:11.614382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef6f8b15-75b9-4f73-bc7e-3fea1b467575 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1340 microversion: 2.20 time: 0.115219 Jun 17 12:52:11.619455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 48/83] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:11.873668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:11.889730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a8d20a84-9ea3-42d6-8234-be58ab5e0a85 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 1.068196 Jun 17 12:52:11.891566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 36/84] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:10 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:12.032634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:12.033864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:12.042283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.044214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.045206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.045774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.146392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:12.156266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fb655cf7-ffda-4b2e-9f24-f34bd830fe6d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1295 microversion: 2.1 time: 0.127339 Jun 17 12:52:12.157270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 49/85] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:12.209721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:12.210593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:12.224815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.225355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.229805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.230254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.518373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:12.519121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:12.534657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.541256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.542331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.542948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.718877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:12.728495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d4c54f45-0be7-48ab-b5cd-b2a796031a3d tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.524053 Jun 17 12:52:12.729103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 37/86] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:12 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:12.735139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:12.736034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:12.742292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.742810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.743831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.744324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.756800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:12.776294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b863937a-29b5-4afb-a525-0aafa722e8ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.265185 Jun 17 12:52:12.777201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 50/87] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:12.906526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:12.913145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:12.914699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:12.920889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:12.926702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:12.928606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e739732b-2ceb-4848-9746-f9799649df51 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1340 microversion: 2.20 time: 0.198361 Jun 17 12:52:12.931004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 38/88] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1340 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:12.934404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.934862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:12.935683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:12.936112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.179703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:13.180603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:13.181496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:13.190754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.191160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-88d5d875-e591-4584-84c8-6f9f5d7d3670 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.286761 Jun 17 12:52:13.191389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.193280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 51/89] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:12 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:13.204408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.204889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.624445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:13.640875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b93465b9-9339-48c8-bcc4-085c103f5ec7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.469117 Jun 17 12:52:13.651119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 39/90] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:13.746209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:13.746794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:13.753129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.753575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.754341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.754765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.793580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:13.794484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:13.810862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.812068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.813054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.813722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.890278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:13.897982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-efd2ac9b-da39-4c28-976c-df93e0ad4356 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.155724 Jun 17 12:52:13.898782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 52/91] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:13 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:13.948821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:13.949656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:13.956300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.956855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.957675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:13.958193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:13.965595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:13.974130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-450b69f6-c596-43ed-a260-34b4cbdce55f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.184619 Jun 17 12:52:13.974716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 40/92] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:14.095890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:14.104312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:14.106491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:14.108256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d6040aef-8a90-4c95-ade2-68b504b7b6b8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.163205 Jun 17 12:52:14.109293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 53/93] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:52:14.209003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:14.209760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:14.216559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:14.217217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:14.217977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:14.218404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:14.367723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:14.375404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3144666f-70db-4288-9970-4b23beddc1ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.170294 Jun 17 12:52:14.376799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 41/94] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:14 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:14.657880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:14.658473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:14.664755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:14.665203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:14.665973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:14.666401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:14.805211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:14.813899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e0fc2ddd-223e-4e9c-8298-9b00a437815b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.159640 Jun 17 12:52:14.814335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 54/95] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:14.916143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:14.916726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:14.925623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:14.926107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:14.927464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:14.927596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:14.993799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:14.994954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:15.001823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.002475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.003598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.004295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.076528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:15.089387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e47e565b-18bf-40e9-bd76-c2eeb1b0c3a7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.176885 Jun 17 12:52:15.090404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 42/96] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:14 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:15.126235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:15.128563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:15.140139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.143782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.147545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.148721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.206437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:15.214471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f7f37c0-5269-45a1-beb1-4037ac8f688c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.226190 Jun 17 12:52:15.215269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 55/97] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:15.399281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:15.400129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:15.407635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.408280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.409232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.409670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.555485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:15.565139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bacad612-86e7-4380-87f9-57a960eb42e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.175542 Jun 17 12:52:15.574946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 56/98] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:15 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:15.834013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:15.834948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:15.842167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.842749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.843687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:15.844239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:15.999558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:16.007821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c8db3667-94ee-491c-a730-d739df7933db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.180283 Jun 17 12:52:16.008889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 57/99] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:16.074937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:16.078625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:16.084009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:16.086140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:16.087823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34f9053f-c077-46b0-9991-41f18f5b31bd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.965677 Jun 17 12:52:16.090547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 43/100] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:16.109909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:16.112375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:16.135803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:16.136441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:16.142696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:16.142696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:16.240760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:16.241893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:16.255502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:16.256457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:16.258693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:16.259687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:16.411796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:16.420939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f32923a0-7079-4488-9c42-08a04eac5a77 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.317245 Jun 17 12:52:16.423534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 58/101] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:16 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:16.582689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:16.583671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:16.590363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:16.591111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:16.592508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:16.593066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:16.763921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:16.774367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dea066c8-450f-4b9a-9e08-d9c6be129d58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.195651 Jun 17 12:52:16.775617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 59/102] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:16 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:16.926641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:16.935001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a7b01fbb-fc87-4295-b50a-7b7c0027957a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.701358 Jun 17 12:52:16.935565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 44/103] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:17.025665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:17.026309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:17.033166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.033733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.034527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.035198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.110354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:17.111654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:17.124888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.125335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.126114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.126542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.233516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:17.241848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-798885d1-5e9e-4a41-8e87-4cbd81cc1d56 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.220253 Jun 17 12:52:17.242432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 60/104] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:17.442554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:17.443599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:17.464963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.465725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.469121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.471756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.768655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:17.790615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bdca9e06-e86b-4823-ac26-17f50af5168e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.354310 Jun 17 12:52:17.791223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 61/105] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:17 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:17.797622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:17.798229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:17.811522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.812224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.813376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.813960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.904613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:17.927907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:17.934181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:17.940747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-43d404e3-7e22-41c2-a10d-a97c33dfe019 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.833126 Jun 17 12:52:17.941835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 45/106] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:52:17.964657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:17.965666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:17.978520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.979445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:17.980556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:17.981312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:18.045944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:18.057652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-915572b7-e0fa-45d8-be2c-d968c256d0f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.261599 Jun 17 12:52:18.060316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 62/107] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:17 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:18.259267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:18.260316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:18.267427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:18.268099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:18.268921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:18.269618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:18.413600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:18.417335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:18.422684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c2a2dd94-0015-4192-aa04-8a1eae4b5875 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.167427 Jun 17 12:52:18.423502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 63/108] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:18.487586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:18.495317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5ab14406-d388-4d13-b060-ef34ca45f8b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.536778 Jun 17 12:52:18.504769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 46/109] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:18.609383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-2c8b0f3f-64f1-440b-a4c1-36d4a7a6a234 req-d0d4b16d-2ccf-4429-91de-384b14382681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:18.622163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-2c8b0f3f-64f1-440b-a4c1-36d4a7a6a234 req-d0d4b16d-2ccf-4429-91de-384b14382681 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:18.623276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-2c8b0f3f-64f1-440b-a4c1-36d4a7a6a234 req-d0d4b16d-2ccf-4429-91de-384b14382681 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:18.653836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-2c8b0f3f-64f1-440b-a4c1-36d4a7a6a234 req-d0d4b16d-2ccf-4429-91de-384b14382681 service nova] Creating event network-changed:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 12:52:18.663205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-2c8b0f3f-64f1-440b-a4c1-36d4a7a6a234 req-d0d4b16d-2ccf-4429-91de-384b14382681 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057439 Jun 17 12:52:18.664249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 64/110] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:52:18.812663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:18.813351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:18.820084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:18.820619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:18.821547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:18.821986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:18.965955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:18.967340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:18.981461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:18.981623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:18.983202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:18.983886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:19.136330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:19.146140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34367b67-fe9a-4806-9339-0b471f69f664 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.337882 Jun 17 12:52:19.146864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 47/111] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:18 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:19.158794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:19.159612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:19.165932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:19.166367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:19.167174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:19.167692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:19.314998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:19.323073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1c8f909d-88db-4ca3-81a5-10d13d11f027 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.175053 Jun 17 12:52:19.323858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 48/112] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:19 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:19.410834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:19.420039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:19.421539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:19.422966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-982695ab-77e9-4720-86cd-02c80134b348 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.462152 Jun 17 12:52:19.423880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 65/113] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:52:19.439391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:19.440003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:19.445951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:19.446393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:19.447154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:19.447647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:19.511918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:19.512528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:19.520195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:19.520815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:19.523547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:19.524137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:19.592054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:19.600871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4a77a4f0-21df-428b-b624-a4a65553d789 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.165252 Jun 17 12:52:19.601442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 49/114] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:19.678605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:19.690057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2148d3ff-e3e8-4e58-93af-659e7301d918 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.181986 Jun 17 12:52:19.690731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 66/115] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:20.163542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:20.164143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:20.173513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.184065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.185213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.185875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.341224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:20.342374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:20.354877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.356401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.357193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.357989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.549822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:20.559453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9c112bce-bd67-4571-951e-c916a9e610f2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.223609 Jun 17 12:52:20.560066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 67/116] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:20 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:20.570005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:20.570774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:20.578008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.578445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.579223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.579682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.740417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:20.751081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:20.753724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:20.755882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-649d9fed-40cb-4a1d-8201-e83d95b3ab3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.193981 Jun 17 12:52:20.756459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 68/117] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:20.765006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:20.765979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:20.773253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.773506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.774338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.774840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.920652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:20.928455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9cc9f237-14f4-4b4b-8d3b-c5acf6afc877 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.170479 Jun 17 12:52:20.929017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 69/118] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:20.942702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:20.943584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:20.950382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.951105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:20.952001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:20.952499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:21.124455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:21.135042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1ac0b4e8-486b-400a-9679-629436611bd9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.196007 Jun 17 12:52:21.136064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 70/119] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:21.140695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-cf72e3ec-a76b-49a8-9580-2d21b860121b req-116b3f01-377f-4790-abd2-55009dfa79fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceba3cc8-f8bd-4909-bce2-0f05c17bf50b", "tag": "4924add8-7678-4629-88d8-06156837085a"}, {"name": "network-changed", "server_uuid": "57e80959-0f5b-4f32-934a-f939416afe0a", "tag": "1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22"}, {"name": "network-changed", "server_uuid": "00ab137b-ba6b-4ea1-96d9-2cad4c99cc75", "tag": "03578bdb-440d-45ad-9a69-0e303f40d8ec"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:21.150767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-cf72e3ec-a76b-49a8-9580-2d21b860121b req-116b3f01-377f-4790-abd2-55009dfa79fb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:21.151643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-cf72e3ec-a76b-49a8-9580-2d21b860121b req-116b3f01-377f-4790-abd2-55009dfa79fb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:21.160524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:21.170618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-cf72e3ec-a76b-49a8-9580-2d21b860121b req-116b3f01-377f-4790-abd2-55009dfa79fb service nova] Creating event network-changed:4924add8-7678-4629-88d8-06156837085a for instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b on hv-cinder-84617 Jun 17 12:52:21.171973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-cf72e3ec-a76b-49a8-9580-2d21b860121b req-116b3f01-377f-4790-abd2-55009dfa79fb service nova] Creating event network-changed:1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22 for instance 57e80959-0f5b-4f32-934a-f939416afe0a on hv-cinder-84617 Jun 17 12:52:21.172683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-cf72e3ec-a76b-49a8-9580-2d21b860121b req-116b3f01-377f-4790-abd2-55009dfa79fb service nova] Creating event network-changed:03578bdb-440d-45ad-9a69-0e303f40d8ec for instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 on hv-cinder-84617 Jun 17 12:52:21.174913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-394b32c8-98ed-49d2-ad67-6029b5e95689 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 1.013827 Jun 17 12:52:21.180283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 50/120] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:20 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:21.211314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-cf72e3ec-a76b-49a8-9580-2d21b860121b req-116b3f01-377f-4790-abd2-55009dfa79fb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.073955 Jun 17 12:52:21.212291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 71/121] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:21.576891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:21.577499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:21.588753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:21.589322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:21.589982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:21.590412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:21.772564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:21.778127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:21.779328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:21.806370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:21.808058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:21.821169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:21.836886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.167786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:22.169448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:22.177351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-24c35724-19e5-491f-a645-b93b964d4db2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.604611 Jun 17 12:52:22.177924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 51/122] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:21 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:22.180355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:22.183569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:22.187636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f51208ca-d034-4541-8992-faa5960dd776 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.414543 Jun 17 12:52:22.187636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 72/123] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:22.202590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:22.208642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:22.216098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:22.217238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.218502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:22.219144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.279576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-ade4505a-4cf3-4798-9ee7-326bfb251a1e req-48e1a90a-2f1c-4bb3-bdba-4f8154d072f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d77c9b-4a5f-469d-9a72-ced7b26a4138", "name": "network-vif-plugged", "status": "completed", "tag": "d72f5648-68ed-4330-b798-01859fad53c5"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:22.288496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-ade4505a-4cf3-4798-9ee7-326bfb251a1e req-48e1a90a-2f1c-4bb3-bdba-4f8154d072f8 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:22.288989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-ade4505a-4cf3-4798-9ee7-326bfb251a1e req-48e1a90a-2f1c-4bb3-bdba-4f8154d072f8 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.300800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-ade4505a-4cf3-4798-9ee7-326bfb251a1e req-48e1a90a-2f1c-4bb3-bdba-4f8154d072f8 service nova] Creating event network-vif-plugged:d72f5648-68ed-4330-b798-01859fad53c5 for instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 on hv-cinder-84617 Jun 17 12:52:22.305728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-ade4505a-4cf3-4798-9ee7-326bfb251a1e req-48e1a90a-2f1c-4bb3-bdba-4f8154d072f8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117490 Jun 17 12:52:22.306326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 73/124] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:22.315502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:22.316357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:22.323268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:22.323792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.324565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:22.325612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.369392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:22.377587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6bdfdc1-d86b-4e24-92b1-15977a29b19f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.194667 Jun 17 12:52:22.378162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 52/125] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:22.382727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:22.383345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:22.391644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:22.392104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.392865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:22.393285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:22.516508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:22.525108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-647c8965-5bcb-4d3a-a49c-c972ea5ce4d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.213754 Jun 17 12:52:22.525994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 74/126] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:22.526102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:22.535792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6b8434e3-96f3-4070-8638-f2a2b36cc207 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.154632 Jun 17 12:52:22.535792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 53/127] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:22 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:23.193998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:23.195533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:23.204609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.206344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.208037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.208865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.209900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:23.210602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:23.225561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.226019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.226864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.227510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.412446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:23.421248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e0df1e32-9abb-4988-b2f2-ac25884d32d7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.230968 Jun 17 12:52:23.422330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 75/128] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:23 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:23.422820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:23.427226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:23.428462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:23.433613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:23.435390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.435907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.436082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:23.436763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.437288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.437677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e16b3486-4603-4d0e-b213-60f09505edb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.237048 Jun 17 12:52:23.438365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 54/129] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:23.541883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:23.542639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:23.556561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.557011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.557789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.558376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.600810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:23.609625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-96998515-2e02-46b6-b6ec-8466458eed23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.186124 Jun 17 12:52:23.610367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 76/130] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:23.615436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:23.616040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:23.622222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.625722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.625722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:23.625722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:23.767118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:23.775263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3e0faaee-ca8d-46e2-adb1-bedf79af0e5b tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.163422 Jun 17 12:52:23.776127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 77/131] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:23 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:23.930804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:23.939790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c76adf3e-1012-4714-bad8-be0a4bed8efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.401610 Jun 17 12:52:23.949575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 55/132] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:24.330349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-8b458f2b-0b04-484b-874d-85142dd355fc req-56f11256-fcaf-427e-b51a-589bd0e66446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c79dff5-fa8d-4a6c-9097-833e4b9bfc70", "name": "network-vif-plugged", "status": "completed", "tag": "1ff34f55-6087-4fc6-8b79-f24499ec625a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:24.340899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-8b458f2b-0b04-484b-874d-85142dd355fc req-56f11256-fcaf-427e-b51a-589bd0e66446 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:24.342184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-8b458f2b-0b04-484b-874d-85142dd355fc req-56f11256-fcaf-427e-b51a-589bd0e66446 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:24.357879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-8b458f2b-0b04-484b-874d-85142dd355fc req-56f11256-fcaf-427e-b51a-589bd0e66446 service nova] Creating event network-vif-plugged:1ff34f55-6087-4fc6-8b79-f24499ec625a for instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 on hv-cinder-84617 Jun 17 12:52:24.364744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-8b458f2b-0b04-484b-874d-85142dd355fc req-56f11256-fcaf-427e-b51a-589bd0e66446 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041648 Jun 17 12:52:24.366115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 78/133] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:24.440878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:24.441482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:24.448888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:24.451180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:24.457633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:24.458419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:24.460587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:24.461681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:24.472818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:24.474293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:24.476073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:24.478210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:24.758777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:24.778466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:24.779976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:24.781069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a052f92b-14dc-4b74-bb10-093aff3dd1c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.328877 Jun 17 12:52:24.781623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 79/134] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:52:24.798762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:24.799589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:24.835303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:24.837759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:24.839149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:24.839963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:25.056644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:25.067635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa81ba8c-3fc0-4cc2-b57e-f58e18689c94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.631591 Jun 17 12:52:25.068652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 56/135] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:24 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:25.088032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:25.105353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:25.105353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:25.115157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b6120338-700b-4196-8b72-7b5408712180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.323359 Jun 17 12:52:25.126500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 80/136] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:25.126990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:25.126990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:25.126990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:25.126990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:25.144803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:25.150861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:25.173053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:25.174682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:25.179921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:25.180693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:25.439148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:25.453391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:25.457767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-159e9fe4-13e3-4530-951f-a4d1c81b8ae4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.329091 Jun 17 12:52:25.465906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 81/137] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:25.475638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-53d0b3b4-a3b0-4a83-8f91-09f093d8986c tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.403930 Jun 17 12:52:25.477725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 57/138] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:25 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:25.808195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:25.809907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:25.827869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:25.830358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:25.832510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:25.833837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.017935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:26.027528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:26.029317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:26.030433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0e84460-1c87-491e-acce-6f1418260722 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.226656 Jun 17 12:52:26.030992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 82/139] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:26.085769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:26.086291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:26.096750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.097453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.098521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.099004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.134236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:26.135077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:26.141616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.142052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.143069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.143689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.148164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:26.316601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:26.329349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6a2520fb-6e01-4ef5-be54-ffa60b0d3700 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.199535 Jun 17 12:52:26.350217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 83/140] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:26.366821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:26.375962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4ea98c73-7888-43e1-9663-23e9070454c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.294406 Jun 17 12:52:26.376902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 58/141] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:26 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:26.477180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:26.477977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:26.482104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:26.487225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.488011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.496371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:26.498418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:26.503443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.504160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.516875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.517318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.518095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:26.518522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:26.708703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:26.717524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3d6e6f93-f206-418b-9295-bb6557c5e75d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.244457 Jun 17 12:52:26.718549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 84/142] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:26.836661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:26.844674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-53938294-fede-467c-8faf-baafc96a74ce tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.354421 Jun 17 12:52:26.845245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 59/143] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:26 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:27.064900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:27.069518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:27.080276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.080714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.081483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.081912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.239563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:27.249121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:27.250985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:27.252143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1a9e39cf-f2dc-4196-8dbf-7dd24ec8d23b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.201301 Jun 17 12:52:27.263245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 85/144] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:27.349442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:27.350578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:27.360754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.361552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.362504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.363112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.390474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:27.395138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:27.395967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:27.404935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.405375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.407234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.407688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.603355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:27.619485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b32daac2-85f0-4b4a-9eb4-9b53440e524a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.272140 Jun 17 12:52:27.620368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 60/145] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:27.647354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:27.656611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f915b0d0-646d-42e5-b2d5-c865b89338c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.266141 Jun 17 12:52:27.659428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 86/146] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:27 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:27.734617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:27.734617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:27.741691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.742149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.742995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.743528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.864468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:27.865407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:27.880978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.882098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.885869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:27.886911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:27.992817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:28.003151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5cf0c21d-2260-4876-ba5f-60ea371dc1d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.270862 Jun 17 12:52:28.004886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 61/147] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:28.021557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-b038f952-ff3b-481e-82e2-d514f3ea7097 req-0528eeab-d647-4886-b98a-3f2ff944e9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ab137b-ba6b-4ea1-96d9-2cad4c99cc75", "name": "network-vif-plugged", "status": "completed", "tag": "03578bdb-440d-45ad-9a69-0e303f40d8ec"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:28.035815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b038f952-ff3b-481e-82e2-d514f3ea7097 req-0528eeab-d647-4886-b98a-3f2ff944e9b0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:28.036729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b038f952-ff3b-481e-82e2-d514f3ea7097 req-0528eeab-d647-4886-b98a-3f2ff944e9b0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:28.053798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-b038f952-ff3b-481e-82e2-d514f3ea7097 req-0528eeab-d647-4886-b98a-3f2ff944e9b0 service nova] Creating event network-vif-plugged:03578bdb-440d-45ad-9a69-0e303f40d8ec for instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 on hv-cinder-84617 Jun 17 12:52:28.063292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-b038f952-ff3b-481e-82e2-d514f3ea7097 req-0528eeab-d647-4886-b98a-3f2ff944e9b0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049622 Jun 17 12:52:28.064324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 62/148] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:28.137933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:28.150126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f6f084f-7986-4758-98f9-cca2029f9471 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.291328 Jun 17 12:52:28.150992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 87/149] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:27 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:28.271103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:28.271819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:28.275542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:28.280352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:28.281016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:28.281771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:28.282222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:28.433937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:28.444129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:28.445631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:28.446727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-00ced3c5-e34f-408a-b3bd-8040957d1634 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.180150 Jun 17 12:52:28.447327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 63/150] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:52:28.639285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:28.639992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:28.647914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:28.648539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:28.649232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:28.649663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:28.673672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:28.674283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:28.682331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:28.682882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:28.684864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:28.685514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:28.818615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:28.827273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-129e0fb1-d9a6-43ec-9927-f6e4f59e613d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.193645 Jun 17 12:52:28.828174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 88/151] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:28.861353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:28.868986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5a80e3ee-ada6-4ba0-8dbd-95fef96f0008 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.199121 Jun 17 12:52:28.869602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 64/152] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:28 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:29.020767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:29.021379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:29.027572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.028171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.028973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.029438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.169004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:29.170040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:29.171288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:29.177039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.177868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.178742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.179418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9d9a41ef-4015-440f-9954-91bdeaf3f8fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.162858 Jun 17 12:52:29.179775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.180351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 89/153] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:29.334425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:29.343661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dd530e7a-c474-4e8d-9d9e-208fad0ae909 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.179992 Jun 17 12:52:29.344423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 65/154] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:29 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:29.465302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:29.465997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:29.472977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.473535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.474379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.474876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.604190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:29.612413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:29.613907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:29.615009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9bebac90-a424-4a9a-bb19-607bb97e6389 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.154061 Jun 17 12:52:29.615611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 90/155] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:29.844626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:29.845162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:29.851267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.851749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.852497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.852919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.886041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:29.887101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:29.894509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.895083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:29.896143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:29.896664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.002910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:30.010507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a40601e8-432d-42f3-b7bb-dffdb5d4e7fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.170659 Jun 17 12:52:30.011064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 66/156] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:30.034461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:30.042058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-78a05d6f-ce24-434a-a8ef-6c152aeb8f27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.159879 Jun 17 12:52:30.042632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 91/157] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:29 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:30.100719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-ced78256-de76-44c2-9022-908ca7182dd0 req-6a4db310-8eb2-46ae-90cb-58e6ca0c5cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceba3cc8-f8bd-4909-bce2-0f05c17bf50b", "name": "network-vif-plugged", "status": "completed", "tag": "4924add8-7678-4629-88d8-06156837085a"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:30.109233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-ced78256-de76-44c2-9022-908ca7182dd0 req-6a4db310-8eb2-46ae-90cb-58e6ca0c5cf2 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:30.109660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-ced78256-de76-44c2-9022-908ca7182dd0 req-6a4db310-8eb2-46ae-90cb-58e6ca0c5cf2 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.121063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-ced78256-de76-44c2-9022-908ca7182dd0 req-6a4db310-8eb2-46ae-90cb-58e6ca0c5cf2 service nova] Creating event network-vif-plugged:4924add8-7678-4629-88d8-06156837085a for instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b on hv-cinder-84617 Jun 17 12:52:30.126794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-ced78256-de76-44c2-9022-908ca7182dd0 req-6a4db310-8eb2-46ae-90cb-58e6ca0c5cf2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029680 Jun 17 12:52:30.127347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 67/158] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:30.200133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:30.203224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:30.218882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:30.219756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.221917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:30.222617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.361774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:30.362916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:30.376425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:30.376926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.377756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:30.378246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.419628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:30.433328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11b8e665-1b1d-44a5-8d2c-263227146d59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.240132 Jun 17 12:52:30.444810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 92/159] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:30.611069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:30.623418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0e929f17-88ce-40ec-8ef0-9fae5c3d52c6 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.265978 Jun 17 12:52:30.625709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 68/160] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:30 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:30.637843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:30.638655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:30.647837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:30.649343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.650244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:30.652900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:30.898468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:30.908504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:30.912093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:30.913309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4cc366b6-8b13-4476-9745-93cfdfbbd9cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.283380 Jun 17 12:52:30.913935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 93/161] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:31.028777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:31.030183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:31.049737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.050415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.054590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.060275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.066655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:31.067808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:31.077940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.078720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.081077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.081658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.317996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:31.329665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc75ed27-16c7-4c99-974a-e6f93b77ffc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.305999 Jun 17 12:52:31.330661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 69/162] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:31.391020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:31.399039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e8f8a7db-831f-446a-815f-55e74b65f8ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1321 microversion: 2.1 time: 0.344776 Jun 17 12:52:31.399944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 94/163] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:31 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:31.461663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:31.462274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:31.469733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.471907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.473086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.473857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.641681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:31.642281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:31.649413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.650472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.651516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.652370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.701622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:31.714147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4ae65a37-56a3-4430-9e45-4784f2cb00cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.256241 Jun 17 12:52:31.715476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 70/164] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:31.821972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:31.832853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eae7f728-6d46-438c-a1c5-5973090f88b8 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.195044 Jun 17 12:52:31.834019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 95/165] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:31 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:31.932196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:31.933171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:31.941567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.942254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:31.943291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:31.943873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.347652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:32.351137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:32.359702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.360326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.361250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.361857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.370520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:32.382869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:32.388726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:32.390222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-54c5afe3-4133-4789-86c9-b06966aaebe9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.462750 Jun 17 12:52:32.392270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 71/166] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:32.416978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:32.417788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:32.425616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.426144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.427097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.427575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.555758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:32.563991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1616faa2-d0c5-432f-8ca0-17f7004126dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.220144 Jun 17 12:52:32.567780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 96/167] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:32.615034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:32.622947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-652f6f6b-6725-4153-8dbc-6b39e5d14daf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1514 microversion: 2.1 time: 0.209812 Jun 17 12:52:32.623540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 72/168] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:32 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:32.641563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:32.642789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:32.650319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.650767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.651925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.652932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.721185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'flavor' on Instance uuid 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:52:32.733430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:32.734176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:32.742911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.744584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.747269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.747728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.868864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:32.891401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-58ee1cc5-7cf1-4730-86d0-165771befa5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70/action" status: 200 len: 32 microversion: 2.1 time: 0.254267 Jun 17 12:52:32.892008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 97/169] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:52:32 2022] POST /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 12:52:32.903661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-4ae7e8c7-d71a-439d-8e04-b405830ec0fa req-1ce14375-2a3e-4490-b255-6c8d84d0e2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "name": "network-vif-plugged", "status": "completed", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:32.917165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4ae7e8c7-d71a-439d-8e04-b405830ec0fa req-1ce14375-2a3e-4490-b255-6c8d84d0e2f5 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.918274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4ae7e8c7-d71a-439d-8e04-b405830ec0fa req-1ce14375-2a3e-4490-b255-6c8d84d0e2f5 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.946081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-4ae7e8c7-d71a-439d-8e04-b405830ec0fa req-1ce14375-2a3e-4490-b255-6c8d84d0e2f5 service nova] Creating event network-vif-plugged:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 12:52:32.951528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-4ae7e8c7-d71a-439d-8e04-b405830ec0fa req-1ce14375-2a3e-4490-b255-6c8d84d0e2f5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054592 Jun 17 12:52:32.952461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 98/170] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:32.958275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:32.959071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:32.966378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.967082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.968239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:32.968670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:32.986772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:32.997772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-20ba84f5-80ab-4918-a219-8a420a6bb4eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.268796 Jun 17 12:52:32.998879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 73/171] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:33.004273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:33.005035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:33.012246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:33.013057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:33.014297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:33.015026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:33.167568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:33.177775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-82055101-b22a-48c0-9511-f4f79b4feadf tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1314 microversion: 2.1 time: 0.224082 Jun 17 12:52:33.179197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 99/172] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:32 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:33.179449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:33.188094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8f73dc68-52a2-45d6-8407-a245ff1956fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.187999 Jun 17 12:52:33.188669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 74/173] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:32 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:33.410480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:33.411130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:33.418924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:33.419615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:33.420810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:33.421242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:33.581524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:33.582122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:33.589793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:33.590976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:33.591780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:33.592283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:33.678041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:33.693477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:33.697869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:33.701493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98812f1e-6487-4229-9180-0ffea2e34588 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.294592 Jun 17 12:52:33.704337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 100/174] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:33.853738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:33.862735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-67acc080-910a-4555-9912-d08abd6ba745 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.285036 Jun 17 12:52:33.863653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 75/175] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:34.015520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:34.016394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:34.022755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.023322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.024210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.024702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.188942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:34.198449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:34.200857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8252463f-c5e3-4dff-8fad-71225468fb87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1366 microversion: 2.1 time: 0.190288 Jun 17 12:52:34.201253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:34.202957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 101/176] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:34.208921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:34.209745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:34.210305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.210749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.215196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.215709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.217900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.218536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.219549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.220966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.390884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:34.400169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f3bdfa8f-f99b-470e-961d-fcaadeb43e08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.195730 Jun 17 12:52:34.401197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 102/177] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:34 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:34.650971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:34.659609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-75af8781-3fe2-4cc3-87ed-27cccc58d457 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1502 microversion: 2.1 time: 0.468048 Jun 17 12:52:34.670259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 76/178] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:34 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1502 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:34.725150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:34.725764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:34.733090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.733651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.734428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.740258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.880628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:34.881626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:34.889642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.891004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:34.899462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:34.900516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.013196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:35.024439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:35.027070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:35.029020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8adf0048-1abf-4b44-852b-35ce86510ac9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.308294 Jun 17 12:52:35.041234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 103/179] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:35.046627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-0ff767ba-6ec2-4098-b607-52fc6742bc6e req-4054a21c-c4ec-4a46-a7d9-0b0b9e45cbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e80959-0f5b-4f32-934a-f939416afe0a", "name": "network-vif-plugged", "status": "completed", "tag": "1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:35.056951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-0ff767ba-6ec2-4098-b607-52fc6742bc6e req-4054a21c-c4ec-4a46-a7d9-0b0b9e45cbeb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:35.057682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-0ff767ba-6ec2-4098-b607-52fc6742bc6e req-4054a21c-c4ec-4a46-a7d9-0b0b9e45cbeb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.073146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-0ff767ba-6ec2-4098-b607-52fc6742bc6e req-4054a21c-c4ec-4a46-a7d9-0b0b9e45cbeb service nova] Creating event network-vif-plugged:1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22 for instance 57e80959-0f5b-4f32-934a-f939416afe0a on hv-cinder-84617 Jun 17 12:52:35.079504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-0ff767ba-6ec2-4098-b607-52fc6742bc6e req-4054a21c-c4ec-4a46-a7d9-0b0b9e45cbeb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036580 Jun 17 12:52:35.080863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 104/180] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:35.221748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:35.222865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:35.238951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:35.240664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.242394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:35.244315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:35.246401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.273274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d91cbfd1-c2dc-4e2f-b2f6-928c0266a17a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.397410 Jun 17 12:52:35.273899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 77/181] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:35.419228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:35.420186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:35.426513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:35.426951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.427747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:35.428197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.448823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:35.568640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:35.598579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5cded3ac-af52-4e6e-a2f6-c1ac860d8f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1555 microversion: 2.1 time: 0.381615 Jun 17 12:52:35.601760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 105/182] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1555 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:35.638770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bd2ba7f8-fadb-49fb-a8a6-68b4478f8a99 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:35.640431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bd2ba7f8-fadb-49fb-a8a6-68b4478f8a99 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:35.688782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd2ba7f8-fadb-49fb-a8a6-68b4478f8a99 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:35.691941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd2ba7f8-fadb-49fb-a8a6-68b4478f8a99 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.693302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd2ba7f8-fadb-49fb-a8a6-68b4478f8a99 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:35.693974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd2ba7f8-fadb-49fb-a8a6-68b4478f8a99 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:35.760246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:35.774158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-28b2997a-d74d-472b-9cf7-78822b9b3c99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.359458 Jun 17 12:52:35.775301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 78/183] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:35 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:35.817867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bd2ba7f8-fadb-49fb-a8a6-68b4478f8a99 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192223 Jun 17 12:52:35.818968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 106/184] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 12:52:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:36.048412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:36.049809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:36.057195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:36.057885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:36.058809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:36.059958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:36.268289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:36.278664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:36.280233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:36.281336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d08d70e9-9a07-46e9-bf0f-6c9eb80e5ea3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1407 microversion: 2.20 time: 0.236802 Jun 17 12:52:36.281866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 79/185] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:52:36.290486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:36.291257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:36.299472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:36.300194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:36.301277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:36.301877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:36.398048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1a8a6055-b905-492b-ba4d-d79849927bea tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20462374-e5aa-4a8b-8cd8-f69011ad522e"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:36.399753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1a8a6055-b905-492b-ba4d-d79849927bea tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:36.406795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a8a6055-b905-492b-ba4d-d79849927bea tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:36.407531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a8a6055-b905-492b-ba4d-d79849927bea tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:36.408371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a8a6055-b905-492b-ba4d-d79849927bea tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:36.408880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a8a6055-b905-492b-ba4d-d79849927bea tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.049717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:37.060268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b8a4affa-21c1-4c2c-968b-2698923bcdf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 0.773231 Jun 17 12:52:37.063869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 107/186] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:37.069240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:37.070237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:37.079427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:37.079892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.081932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:37.082705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.362608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:37.371678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8d122628-a337-4dc6-81db-127940808a9b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.306440 Jun 17 12:52:37.377306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 108/187] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:37 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:37.399547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:37.401903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:37.420748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:37.421809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.428184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:37.429012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.543213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1a8a6055-b905-492b-ba4d-d79849927bea tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "POST /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.149353 Jun 17 12:52:37.548547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 80/188] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 12:52:36 2022] POST /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b/os-volume_attachments => generated 194 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:52:37.703207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:37.711975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:37.713509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:37.714656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-21ca25e0-1805-4a01-99a0-28d2639d1590 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1600 microversion: 2.20 time: 0.336009 Jun 17 12:52:37.716705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 109/189] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:52:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1600 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:52:37.738553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5cb9b160-947f-449a-a9bd-f149d8192d1f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:37.739841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5cb9b160-947f-449a-a9bd-f149d8192d1f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:37.749249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cb9b160-947f-449a-a9bd-f149d8192d1f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:37.751156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cb9b160-947f-449a-a9bd-f149d8192d1f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.752534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cb9b160-947f-449a-a9bd-f149d8192d1f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:37.753356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5cb9b160-947f-449a-a9bd-f149d8192d1f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.851538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5cb9b160-947f-449a-a9bd-f149d8192d1f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.119446 Jun 17 12:52:37.858263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 81/190] 10.222.0.87 () {60 vars in 1315 bytes} [Fri Jun 17 12:52:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:52:37.865239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-e253056f-eed1-482c-a9eb-e8c96e69477e req-885e403d-973a-4580-94df-d133590790ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ab137b-ba6b-4ea1-96d9-2cad4c99cc75", "tag": "03578bdb-440d-45ad-9a69-0e303f40d8ec"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:37.875774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-e253056f-eed1-482c-a9eb-e8c96e69477e req-885e403d-973a-4580-94df-d133590790ba service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:37.876214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-e253056f-eed1-482c-a9eb-e8c96e69477e req-885e403d-973a-4580-94df-d133590790ba service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:37.909818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-e253056f-eed1-482c-a9eb-e8c96e69477e req-885e403d-973a-4580-94df-d133590790ba service nova] Creating event network-changed:03578bdb-440d-45ad-9a69-0e303f40d8ec for instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 on hv-cinder-84617 Jun 17 12:52:37.928230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-e253056f-eed1-482c-a9eb-e8c96e69477e req-885e403d-973a-4580-94df-d133590790ba service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060860 Jun 17 12:52:37.929065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 110/191] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:38.084210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:38.085114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:38.104574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:38.106976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:38.108358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:38.112171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:38.394222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:38.395076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:38.404055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:38.409346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:38.410471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:38.411115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:38.886682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:38.903271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-15a5dadf-cd9b-4dd2-aeac-96426aaf2c3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.513319 Jun 17 12:52:38.923971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 111/192] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:38 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:39.193209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:39.207953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ccdfd8b5-f16d-4e2d-972c-96099c0d30b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1362 microversion: 2.1 time: 1.134192 Jun 17 12:52:39.211059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 82/193] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1362 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:39.929156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:39.930080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:39.941437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:39.941881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:39.942652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:39.943084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:40.094984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:40.106787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6236479f-7f2c-4eda-b267-ee63fc1c1cf9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.181460 Jun 17 12:52:40.107987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 112/194] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:39 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:40.226260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:40.227108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:40.238125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:40.238125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:40.238125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:40.238125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:40.460378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:40.470971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cfac2928-c3d3-49a7-ab4e-6d3e7b5795a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1548 microversion: 2.1 time: 0.249475 Jun 17 12:52:40.471663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 83/195] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:40.489726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8839fd3b-70b5-4be1-8b87-1761dda71f15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:40.490985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8839fd3b-70b5-4be1-8b87-1761dda71f15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:40.498973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8839fd3b-70b5-4be1-8b87-1761dda71f15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:40.499832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8839fd3b-70b5-4be1-8b87-1761dda71f15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:40.501393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8839fd3b-70b5-4be1-8b87-1761dda71f15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:40.503617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8839fd3b-70b5-4be1-8b87-1761dda71f15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:40.606217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8839fd3b-70b5-4be1-8b87-1761dda71f15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121220 Jun 17 12:52:40.607282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 113/196] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 12:52:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:40.684401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-971d0e11-d43a-48cb-9f36-bf269935eda1 req-ac4f9e5a-fdc1-41b7-92a0-d1aad6698aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:40.697978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-971d0e11-d43a-48cb-9f36-bf269935eda1 req-ac4f9e5a-fdc1-41b7-92a0-d1aad6698aec service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:40.698571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-971d0e11-d43a-48cb-9f36-bf269935eda1 req-ac4f9e5a-fdc1-41b7-92a0-d1aad6698aec service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:40.744405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-971d0e11-d43a-48cb-9f36-bf269935eda1 req-ac4f9e5a-fdc1-41b7-92a0-d1aad6698aec service nova] Creating event network-changed:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 12:52:40.756203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-971d0e11-d43a-48cb-9f36-bf269935eda1 req-ac4f9e5a-fdc1-41b7-92a0-d1aad6698aec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075759 Jun 17 12:52:40.756861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 84/197] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:41.125053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:41.126214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:41.143081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:41.143841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:41.144788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:41.145363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:41.903428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:41.914480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1bff3301-bdec-4306-817c-53e866d7e0ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.793787 Jun 17 12:52:41.925462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 114/198] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:41 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:42.309389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-b41bf883-66ae-4eec-92db-138ce4d104f4 req-e5c83389-f904-4903-8545-1edc29420e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e80959-0f5b-4f32-934a-f939416afe0a", "tag": "1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:42.318698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b41bf883-66ae-4eec-92db-138ce4d104f4 req-e5c83389-f904-4903-8545-1edc29420e69 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:42.319137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b41bf883-66ae-4eec-92db-138ce4d104f4 req-e5c83389-f904-4903-8545-1edc29420e69 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:42.330721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-b41bf883-66ae-4eec-92db-138ce4d104f4 req-e5c83389-f904-4903-8545-1edc29420e69 service nova] Creating event network-changed:1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22 for instance 57e80959-0f5b-4f32-934a-f939416afe0a on hv-cinder-84617 Jun 17 12:52:42.338128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-b41bf883-66ae-4eec-92db-138ce4d104f4 req-e5c83389-f904-4903-8545-1edc29420e69 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033749 Jun 17 12:52:42.338736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 85/199] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:52:42.932745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:42.933968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:42.954322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:42.955132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:42.955929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:42.956542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:43.099903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:43.107612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dc1829f6-9395-434d-93a4-323d58270a0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.179171 Jun 17 12:52:43.108184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 115/200] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:42 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:44.125749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:44.126443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:44.132852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:44.133292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:44.134047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:44.134517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:44.269033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:44.276677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b1b915cf-5cea-4268-b358-87cfc82d2164 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.155825 Jun 17 12:52:44.277227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 86/201] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:44 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:45.293528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:45.294304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:45.301095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:45.301480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:45.302238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:45.302667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:45.440089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:45.447634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c770146e-98fb-4aa5-af55-a86ef59dea01 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.158078 Jun 17 12:52:45.448194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 116/202] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:45 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:46.465311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:46.466024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:46.473291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:46.473771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:46.474552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:46.474979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:46.619739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:46.627702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3f5f7cc3-a73a-4f92-91b2-71492f752eb1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.166372 Jun 17 12:52:46.628281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 87/203] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:46 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:47.645194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:47.645832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:47.652673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:47.653117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:47.653883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:47.654313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:47.659015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:47.798598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:47.808435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-559359db-b17f-4a30-9ab6-974a487cf3c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.166943 Jun 17 12:52:47.809332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 117/204] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:47 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:48.826751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:48.828780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:48.835282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:48.835446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:48.836156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:48.836581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:48.973009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:48.980549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4cb827cf-e8cb-4866-ab39-32c73b788bf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.158576 Jun 17 12:52:48.981105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 88/205] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:48 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:49.934611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-918759162", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "networks": [{"uuid": "6485a38a-cadf-45b4-9c4a-5ab5416734e5"}]}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:49.986303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] validate_networks() for [('6485a38a-cadf-45b4-9c4a-5ab5416734e5', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:52:49.998486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:49.999094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:50.006373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.007177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.008021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.008445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.156346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:50.164510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bf24c563-2169-4aa4-9681-e97e1caccd56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.170510 Jun 17 12:52:50.165067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 89/206] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:49 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:50.366061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:52:50.366482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:52:50.366952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:52:50.367348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:52:50.367876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:52:50.377747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.378189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.378975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.380084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.400654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Getting quotas for project fd3e386b03924805aea83ba593c80d27. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:52:50.404622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Getting quotas for user fafe1438091c4f6db0c7087a8b215127 and project fd3e386b03924805aea83ba593c80d27. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:52:50.416052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:52:50.418574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:52:50.478005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4a4d7e2-3b64-408a-a0ea-c3edb8e4d216 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547313 Jun 17 12:52:50.479509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 118/207] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:52:50.490618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5b255940-d6b5-4ba0-a44c-b795523dd26d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:50.491157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5b255940-d6b5-4ba0-a44c-b795523dd26d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:50.566917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5b255940-d6b5-4ba0-a44c-b795523dd26d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:50.613070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5b255940-d6b5-4ba0-a44c-b795523dd26d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1213 microversion: 2.1 time: 0.124798 Jun 17 12:52:50.626163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 90/208] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:50 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:50.629462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:50.629967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:50.644156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.644840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.646055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.646713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.690329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 12:52:50.807077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b36da82b-73a2-4e41-858e-4440e7c6c9d0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 204 len: 0 microversion: 2.1 time: 0.189630 Jun 17 12:52:50.808201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 119/209] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 12:52:50 2022] DELETE /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:52:50.817933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:50.819051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:50.826002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.826663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.827621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:50.828435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:50.971982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:50.989212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9c3c7c4e-768b-45d2-a378-800f5443d344 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1554 microversion: 2.1 time: 0.176302 Jun 17 12:52:50.989801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 91/210] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:50 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:51.182718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:51.183413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:51.190266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:51.190812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:51.191729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:51.192205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:51.352171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:51.360479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ebd39393-9ef8-40c6-8a62-d57f417c07ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.182617 Jun 17 12:52:51.361233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 120/211] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:51 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:51.631739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:51.632382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:51.639153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:51.639569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:51.640324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:51.640745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:51.708944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:51.716459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a8a2de7-f955-4ebb-b145-c8d19106a100 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1217 microversion: 2.1 time: 0.089132 Jun 17 12:52:51.717029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 92/212] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:51 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:52.008033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:52.009047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:52.015328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:52.015807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:52.016566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:52.016992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:52.296850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:52.305491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4d683483-80f2-42aa-bc67-95f121a55dac tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1554 microversion: 2.1 time: 0.301832 Jun 17 12:52:52.306122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 121/213] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:52 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1554 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:52.380778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:52.381584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:52.390551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:52.391638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:52.392644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:52.393653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:52.565853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:52.577738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3cc2020b-d0d6-493f-84b0-92fb0addf852 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.201984 Jun 17 12:52:52.579107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 93/214] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:52 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:52.739980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:52.741150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:52.764521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:52.764997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:52.765814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:52.766268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:52.859985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:52.869468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08055379-7980-4466-9c56-b62ae0cef4a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1265 microversion: 2.1 time: 0.138449 Jun 17 12:52:52.875915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 122/215] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:52 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:53.322675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:53.323271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:53.329910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:53.330548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:53.331453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:53.331872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:53.495859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:53.504649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-69dae5fe-7610-4785-af6b-ef1f0817dfb7 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1554 microversion: 2.1 time: 0.185795 Jun 17 12:52:53.505483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 94/216] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:53 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:53.598752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:53.599443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:53.607602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:53.608078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:53.609018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:53.609588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:53.888058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:53.888671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:53.896886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:53.897345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:53.898196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:53.898635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:53.979362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:53.987721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d178a0d0-f0ce-472b-87d6-79e033974754 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1265 microversion: 2.1 time: 0.103476 Jun 17 12:52:53.988837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 95/217] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:53 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:54.073300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:54.081814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e30d97ac-2b89-425b-9ea9-eab50f2e8e58 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.488303 Jun 17 12:52:54.082637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 123/218] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:53 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:54.522627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:54.523396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:54.531873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:54.532597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:54.533536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:54.534069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:54.556505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:54.741362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:54.754563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48a639e8-dc29-42e0-a2fa-d3ad430ff5b9 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1554 microversion: 2.1 time: 0.236155 Jun 17 12:52:54.764139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 96/219] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:54 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:55.006863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:55.008466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:55.012434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:55.024967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:55.026187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:55.028597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:55.029805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:55.102412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:55.103311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:55.110147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:55.110840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:55.112206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:55.113245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:55.279164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:55.287731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-889293fe-3820-438b-8602-39938dac1d00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.189067 Jun 17 12:52:55.289483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 97/220] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:55 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:55.317327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:55.326062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-385849f9-c37e-48a1-a5d5-1e63b0f44a25 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1265 microversion: 2.1 time: 0.324672 Jun 17 12:52:55.329541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 124/221] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:55 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:55.771218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:55.771886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:55.778659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:55.779332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:55.780346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:55.780777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:56.167916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:56.177155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6c3bdd81-e7b4-4408-9598-ec43e68b5496 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1554 microversion: 2.1 time: 0.409823 Jun 17 12:52:56.197786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 98/222] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:55 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1554 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:56.306288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:56.308597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:56.319062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:56.319864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:56.321580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:56.322692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:56.361501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:56.365142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:56.383851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:56.384705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:56.386191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:56.386947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:56.525397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:56.533755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-86da60d7-8944-4768-aeb8-c6bc2b0a4b39 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1271 microversion: 2.1 time: 0.191369 Jun 17 12:52:56.534392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 99/223] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:56 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:56.589733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:56.602068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2fd7b4cb-f1a1-4531-9c74-e9bad10c6da2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.299543 Jun 17 12:52:56.603146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 125/224] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:56 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:57.210701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:57.211410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:57.221949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:57.228746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:57.243490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:57.243625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:57.355344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-09fd32e6-3a18-4334-91fd-f015d0acd992 req-4a489445-bb4d-4d03-9383-fb219fbeaf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceba3cc8-f8bd-4909-bce2-0f05c17bf50b", "name": "network-vif-deleted", "tag": "4924add8-7678-4629-88d8-06156837085a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:57.371358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-09fd32e6-3a18-4334-91fd-f015d0acd992 req-4a489445-bb4d-4d03-9383-fb219fbeaf84 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:57.371811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-09fd32e6-3a18-4334-91fd-f015d0acd992 req-4a489445-bb4d-4d03-9383-fb219fbeaf84 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:57.403991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-09fd32e6-3a18-4334-91fd-f015d0acd992 req-4a489445-bb4d-4d03-9383-fb219fbeaf84 service nova] Creating event network-vif-deleted:4924add8-7678-4629-88d8-06156837085a for instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b on hv-cinder-84617 Jun 17 12:52:57.420937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-09fd32e6-3a18-4334-91fd-f015d0acd992 req-4a489445-bb4d-4d03-9383-fb219fbeaf84 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069125 Jun 17 12:52:57.424655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 126/225] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:52:57.510324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17b8a752d78431dbde11be6d0812de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652fca4387ef47078860b964334a8651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:57.521745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02e6eb81-46e8-46cc-a251-1afa837216f0 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 200 len: 1512 microversion: 2.1 time: 0.320042 Jun 17 12:52:57.523494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 100/226] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:57 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:57.552703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:57.553529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:57.560323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:57.561038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:57.562535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:57.563151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:57.620425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:57.621171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:57.631488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:57.634243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:57.635260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:57.635866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:57.776848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:57.791393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aa1240c3-5703-46fd-af98-0538cc4e7577 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.243685 Jun 17 12:52:57.793157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 127/227] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:57 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:57.928099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:57.937560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b9e1348d-ef56-472e-acb8-9dcd41acc7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.321968 Jun 17 12:52:57.938613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 101/228] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:57 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:58.540404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:58.540981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:58.549456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.549898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:58.550967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.556287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:58.584380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] HTTP exception thrown: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Request method failure captured: Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b HTTP/1.1 Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjlfANRihuxGzsji6eThD8m1v9_6HNkREfH03yYitDWZhTRAUZIZFW5u2ZS9axYy33jtXuFE_Yfjdf13yBfxi47sWyo3W7aaXXt75DO3jShAIwdRTA3nsJgfn_YayoaHf4h-pH5jR2Q9xuaTRGVzrvx4vKdQ3Le4uuHK0s3tdhAT50 Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 12:52:58.589666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/652fca4387ef47078860b964334a8651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_652fca4387ef47078860b964334a8651", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: a17b8a752d78431dbde11be6d0812de3 Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.591145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'ceba3cc8-f8bd-4909-bce2-0f05c17bf50b'} Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:52:58.591979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.593300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.595587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Returning 404 to user: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:52:58.596594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-de3b3ebf-753d-43e7-930a-38e2558d5022 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 404 len: 111 microversion: 2.1 time: 0.060049 Jun 17 12:52:58.598120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 128/229] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:58 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:52:58.750312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:58.751512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:58.762511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=79 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:52:58.766238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.767874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:58.768869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.769433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:58.800045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] HTTP exception thrown: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.811905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:58.812605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:58.823825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Request method failure captured: Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b/os-volume_attachments HTTP/1.1 Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjlfANRihuxGzsji6eThD8m1v9_6HNkREfH03yYitDWZhTRAUZIZFW5u2ZS9axYy33jtXuFE_Yfjdf13yBfxi47sWyo3W7aaXXt75DO3jShAIwdRTA3nsJgfn_YayoaHf4h-pH5jR2Q9xuaTRGVzrvx4vKdQ3Le4uuHK0s3tdhAT50 Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 12:52:58.826145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/652fca4387ef47078860b964334a8651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_652fca4387ef47078860b964334a8651", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: a17b8a752d78431dbde11be6d0812de3 Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.827896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': 'ceba3cc8-f8bd-4909-bce2-0f05c17bf50b'} Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:52:58.828996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:52:58.830393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:52:58.831831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:58.832096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Returning 404 to user: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:52:58.836128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.836574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:58.838122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5d0e5ce5-2dc5-4974-906e-62c890aedcfa tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.090665 Jun 17 12:52:58.838285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 102/230] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:52:58 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b/os-volume_attachments => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:52:58.956900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:52:58.957962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:52:58.977692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.978701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:58.979905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:58.980734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:59.312940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:59.322352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ebe0fc0d-8da4-49e2-a450-2e639bc2cd59 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.516253 Jun 17 12:52:59.323799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 129/231] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:58 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:52:59.375615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:52:59.385840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5b11c9cb-fb7e-4ba9-acae-90e465798f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.435463 Jun 17 12:52:59.396013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 103/232] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:52:58 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:52:59.611537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-48af6a15-a28e-4786-9fd7-d0fede279e74 req-7d3d1e1e-1936-4562-b37c-100b8f0f4562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da71e10-c64b-4ba4-9154-01b731052625", "tag": "32350caa-8a45-4cdc-aff1-1358cbca3b55"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:52:59.624948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-48af6a15-a28e-4786-9fd7-d0fede279e74 req-7d3d1e1e-1936-4562-b37c-100b8f0f4562 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:52:59.625949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-48af6a15-a28e-4786-9fd7-d0fede279e74 req-7d3d1e1e-1936-4562-b37c-100b8f0f4562 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:52:59.639660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-48af6a15-a28e-4786-9fd7-d0fede279e74 req-7d3d1e1e-1936-4562-b37c-100b8f0f4562 service nova] Creating event network-changed:32350caa-8a45-4cdc-aff1-1358cbca3b55 for instance 8da71e10-c64b-4ba4-9154-01b731052625 on hv-cinder-84617 Jun 17 12:52:59.645556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-48af6a15-a28e-4786-9fd7-d0fede279e74 req-7d3d1e1e-1936-4562-b37c-100b8f0f4562 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038054 Jun 17 12:52:59.646161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 130/233] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:00.186814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:00.187318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:00.198988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.203547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.204500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.205114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.245872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] HTTP exception thrown: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Request method failure captured: Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b HTTP/1.1 Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjlfANRihuxGzsji6eThD8m1v9_6HNkREfH03yYitDWZhTRAUZIZFW5u2ZS9axYy33jtXuFE_Yfjdf13yBfxi47sWyo3W7aaXXt75DO3jShAIwdRTA3nsJgfn_YayoaHf4h-pH5jR2Q9xuaTRGVzrvx4vKdQ3Le4uuHK0s3tdhAT50 Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 12:53:00.248077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/652fca4387ef47078860b964334a8651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_652fca4387ef47078860b964334a8651", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: a17b8a752d78431dbde11be6d0812de3 Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.249336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'ceba3cc8-f8bd-4909-bce2-0f05c17bf50b'} Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:53:00.250213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.251257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.262353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Returning 404 to user: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:53:00.263303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cbe8eee2-cd87-4745-b638-e699cc0c8f9e tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 404 len: 111 microversion: 2.1 time: 0.080964 Jun 17 12:53:00.263922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 104/234] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 12:53:00 2022] DELETE /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:53:00.272913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:00.277279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] [instance: ceba3cc8-f8bd-4909-bce2-0f05c17bf50b] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:00.300103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.304146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.305710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.306425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.326296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] HTTP exception thrown: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Request method failure captured: Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b HTTP/1.1 Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjlfANRihuxGzsji6eThD8m1v9_6HNkREfH03yYitDWZhTRAUZIZFW5u2ZS9axYy33jtXuFE_Yfjdf13yBfxi47sWyo3W7aaXXt75DO3jShAIwdRTA3nsJgfn_YayoaHf4h-pH5jR2Q9xuaTRGVzrvx4vKdQ3Le4uuHK0s3tdhAT50 Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 12:53:00.333895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/652fca4387ef47078860b964334a8651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_652fca4387ef47078860b964334a8651", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/652fca4387ef47078860b964334a8651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 652fca4387ef47078860b964334a8651 Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-DeleteServersTestJSON-1702582133 Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: a17b8a752d78431dbde11be6d0812de3 Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-DeleteServersTestJSON-1702582133-project Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.335079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'ceba3cc8-f8bd-4909-bce2-0f05c17bf50b'} Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:53:00.335820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. Jun 17 12:53:00.336924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:00.340193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:00.340810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:00.341368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] Returning 404 to user: Instance ceba3cc8-f8bd-4909-bce2-0f05c17bf50b could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:53:00.342597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-32d75f4a-e460-4ce2-889b-26ca19ea0da1 tempest-DeleteServersTestJSON-1702582133 tempest-DeleteServersTestJSON-1702582133-project] 10.222.0.87 "GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b" status: 404 len: 111 microversion: 2.1 time: 0.073886 Jun 17 12:53:00.343273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 131/235] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:00 2022] GET /compute/v2.1/servers/ceba3cc8-f8bd-4909-bce2-0f05c17bf50b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 12:53:00.369218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.369665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.370639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.371262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.418452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:00.424941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:00.441777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:00.447281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=6 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:00.471401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.473716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.474762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:00.476019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:00.606468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:00.758437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:00.770918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-adfc1d39-581f-41b7-b48e-8899ad7d2e5d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.368851 Jun 17 12:53:00.780615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 132/236] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:00 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:01.033974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:01.045193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02b885a3-2704-46dc-8a27-6a356fbd43c0 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.706420 Jun 17 12:53:01.047512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 105/237] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:00 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:01.803531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:01.805903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:01.828367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:01.834137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:01.835246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:01.835877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:02.065109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:02.065720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:02.076146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:02.079182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:02.082186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:02.085215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:02.118128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:02.136528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d3d274e8-4345-4992-b6c3-5bff35c94239 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.351150 Jun 17 12:53:02.147932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 133/238] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:01 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:02.425196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:02.441452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ba6740eb-04b0-4392-b08d-d0fedaf6ea52 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.381241 Jun 17 12:53:02.444373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 106/239] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:02 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:03.156208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:03.156937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:03.168435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:03.168882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:03.178608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:03.180403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:03.461715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:03.462327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:03.480593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:03.481462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:03.482272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:03.482700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:03.817924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:03.834643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-68ef3dfa-7bb4-470f-9be5-7a9873cb49a1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.377123 Jun 17 12:53:03.835228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 107/240] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:03 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:03.993779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:04.004675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dd9b3a0e-f9e0-4c22-bdf9-07fa2635f7c5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.852768 Jun 17 12:53:04.005557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 134/241] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:03 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:04.852057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:04.853235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:04.881617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:04.885506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:04.887741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:04.889073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:05.030362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:05.030995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:05.041519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:05.041964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:05.042739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:05.043166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:05.072856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:05.453093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:05.510464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3c4fbcf5-264a-4e1e-a11c-3fead897b96e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.661928 Jun 17 12:53:05.536216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 108/242] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:04 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:05.629327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:05.642012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b554b24-3cb9-4c5f-ba15-3f6ad7e49546 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.623635 Jun 17 12:53:05.643161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 135/243] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:05 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:06.259813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9c8fd18f-8371-40be-a5bf-36ca2bfc5050 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Action: 'create', calling method: .version_select at 0x7f454ed32670>, body: {"keypair": {"name": "tempest-TestShelveInstance-82634216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaFnPKgltsJJHS7vSca9RrGZCsAKMzs80mU/EEdYn6OpRy+h3LuOARKPBPDbeRbOKYHe3LyButBEq3dMdfYMkuj9THVv4shPWxtHq4/nNCRL1Z2wXfm7Iat9+OlnZxodg=="}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:06.284567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-9c8fd18f-8371-40be-a5bf-36ca2bfc5050 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Getting quotas for project 3b5f6238effd43d39cbf0af0f4c582f8. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:53:06.302201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-9c8fd18f-8371-40be-a5bf-36ca2bfc5050 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Getting quotas for user 109a46a7108e48c48407681b3e5b1e0c and project 3b5f6238effd43d39cbf0af0f4c582f8. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:53:06.349612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9c8fd18f-8371-40be-a5bf-36ca2bfc5050 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.378036 Jun 17 12:53:06.350584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 109/244] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 12:53:05 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:06.541155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:06.542874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:06.550861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:06.552673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:06.554545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:06.555720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:06.659530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:06.660510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:06.676554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:06.677301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:06.678252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:06.678739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:06.990490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:07.006917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-722077aa-7bfc-4507-9bd1-eed4f5d39910 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.468039 Jun 17 12:53:07.015411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 136/245] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:06 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:07.205887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:07.220134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed83ef87-3898-4776-86e3-20cf19a8943a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.562668 Jun 17 12:53:07.231136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 110/246] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:06 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:07.431499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-02f1bf7d-7341-4090-9092-01c3a55e082d req-8e55ec40-b9a0-4480-a62e-d419aac8f515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da71e10-c64b-4ba4-9154-01b731052625", "name": "network-vif-plugged", "status": "completed", "tag": "32350caa-8a45-4cdc-aff1-1358cbca3b55"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:07.448409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-02f1bf7d-7341-4090-9092-01c3a55e082d req-8e55ec40-b9a0-4480-a62e-d419aac8f515 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:07.449872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-02f1bf7d-7341-4090-9092-01c3a55e082d req-8e55ec40-b9a0-4480-a62e-d419aac8f515 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:07.496077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-02f1bf7d-7341-4090-9092-01c3a55e082d req-8e55ec40-b9a0-4480-a62e-d419aac8f515 service nova] Creating event network-vif-plugged:32350caa-8a45-4cdc-aff1-1358cbca3b55 for instance 8da71e10-c64b-4ba4-9154-01b731052625 on hv-cinder-84617 Jun 17 12:53:07.508194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-02f1bf7d-7341-4090-9092-01c3a55e082d req-8e55ec40-b9a0-4480-a62e-d419aac8f515 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081028 Jun 17 12:53:07.513217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 137/247] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:08.034370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:08.035231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:08.045994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:08.047540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:08.049558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:08.052110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:08.240861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:08.242176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:08.260888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:08.261394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:08.264410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:08.265176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:08.643927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:08.658841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7257667e-8250-4648-be31-70006cd81e0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.424135 Jun 17 12:53:08.668179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 138/248] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:08 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:08.715809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:08.732332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2a1f2e7c-1257-4182-b85b-d17d0db24c24 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1313 microversion: 2.1 time: 0.709749 Jun 17 12:53:08.735270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 111/249] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:08 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:09.676014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:09.679254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:09.693201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:09.693939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:09.695183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:09.695892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:09.754184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:09.756685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:09.771269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:09.784630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:09.787487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:09.788103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:10.071924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:10.084974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6c8e76fb-b48b-4a0c-a40f-e81c4fdf0815 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.412990 Jun 17 12:53:10.089972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 139/250] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:09 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:10.508575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:10.517309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0c7e2b39-8de1-444c-bafd-45d7e491c6e1 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1497 microversion: 2.1 time: 0.768826 Jun 17 12:53:10.520551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 112/251] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:09 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1497 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:11.112557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:11.114006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:11.122656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:11.123597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:11.124879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:11.125467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:11.338927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:11.350146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:11.350731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:11.353609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-27398861-236d-4241-ae29-141e9cbe3086 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.247360 Jun 17 12:53:11.354659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 140/252] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:11 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:11.359977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:11.360767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:11.362214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:11.363957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:11.393238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 12:53:11.459204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:11.497422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8db32847-20b5-4eff-b3eb-662b94e2d5e8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 204 len: 0 microversion: 2.1 time: 0.151336 Jun 17 12:53:11.498746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 113/253] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 12:53:11 2022] DELETE /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:53:11.509645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:11.512527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:11.521439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:11.521975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:11.522982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:11.523518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:11.722893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:11.733295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4e10fdb5-cd10-4b81-af17-fcad615d0ce2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1503 microversion: 2.1 time: 0.230172 Jun 17 12:53:11.734568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 141/254] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:11 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:12.374501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:12.377090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:12.389971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:12.392446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:12.393729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:12.394321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:12.721298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:12.737006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-51722ae8-4741-43ff-b454-135494a22561 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.369097 Jun 17 12:53:12.752251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:12.752857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:12.753052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 114/255] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:12 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:12.760552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:12.760999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:12.761773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:12.762209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:12.938878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:12.961253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4a7307c-d8bf-4af6-8466-af3e5c462fb5 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1503 microversion: 2.1 time: 0.209741 Jun 17 12:53:12.964526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 142/256] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:12 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:13.754162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:13.754760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:13.773386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:13.773887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:13.774904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:13.775345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:13.982090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:13.983345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:13.990904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:13.991344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:13.992136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:13.992561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:14.153799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:14.161906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:14.162419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8b397e04-ec33-44db-8c93-fc3d2a45bb5f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1503 microversion: 2.1 time: 0.185008 Jun 17 12:53:14.164142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 143/257] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:13 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:14.175297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4fc8b166-ea30-4e3c-8ab3-b48566dc0d4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.425037 Jun 17 12:53:14.176255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 115/258] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:13 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:14.575605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-ca3f7f6d-6a6c-444a-bf37-06d2b50758d2 req-ce37a029-b0e9-42e3-8aac-bdaea337a29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da71e10-c64b-4ba4-9154-01b731052625", "name": "network-vif-deleted", "tag": "32350caa-8a45-4cdc-aff1-1358cbca3b55"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:14.584559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-ca3f7f6d-6a6c-444a-bf37-06d2b50758d2 req-ce37a029-b0e9-42e3-8aac-bdaea337a29f service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:14.585142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-ca3f7f6d-6a6c-444a-bf37-06d2b50758d2 req-ce37a029-b0e9-42e3-8aac-bdaea337a29f service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:14.597482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-ca3f7f6d-6a6c-444a-bf37-06d2b50758d2 req-ce37a029-b0e9-42e3-8aac-bdaea337a29f service nova] Creating event network-vif-deleted:32350caa-8a45-4cdc-aff1-1358cbca3b55 for instance 8da71e10-c64b-4ba4-9154-01b731052625 on hv-cinder-84617 Jun 17 12:53:14.602927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-ca3f7f6d-6a6c-444a-bf37-06d2b50758d2 req-ce37a029-b0e9-42e3-8aac-bdaea337a29f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032279 Jun 17 12:53:14.603561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 144/259] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:15.180158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:15.181406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:15.192707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:15.193719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:15.201801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:15.202150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:15.202988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:15.204187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:15.204831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:15.206198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:15.210723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:15.211446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:15.336677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:15.358184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9a850f55-0718-401f-8ef2-acc58ebbbacb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1461 microversion: 2.1 time: 0.182072 Jun 17 12:53:15.364006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 116/260] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:15 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1461 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:15.484023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:15.497011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7f1b533b-4482-4ad4-a904-838fdf0fdce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.305906 Jun 17 12:53:15.507503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 145/261] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:15 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:16.379445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:16.380635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:16.386568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=4 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:16.391186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:16.392028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:16.393157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:16.393848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:16.476594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:16.489827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-04d44ad3-171b-46fb-8b10-bf588a7b790f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1298 microversion: 2.1 time: 0.113395 Jun 17 12:53:16.499645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 117/262] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:16 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:16.522370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:16.522966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:16.534772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:16.535725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:16.536831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:16.537854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:16.814513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:16.825452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-20fc4982-d83e-470e-9da8-a277c4a24b11 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.307002 Jun 17 12:53:16.826042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 146/263] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:16 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:17.514481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:17.514481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:17.534568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:17.535107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:17.536379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:17.537070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:17.585916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:17.586362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:17.586883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lazy-loading 'fault' on Instance uuid 8da71e10-c64b-4ba4-9154-01b731052625 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:53:17.658084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:17.673888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-313d6151-4346-48f0-b571-db8734c81afb tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1303 microversion: 2.1 time: 0.165366 Jun 17 12:53:17.674875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 118/264] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:17 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:17.842433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:17.843069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:17.860006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:17.860647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:17.861858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:17.862450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:18.139696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:18.148914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-323d01dd-98d6-4e59-9f42-83f1bde15cd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.310543 Jun 17 12:53:18.149489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 147/265] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:17 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:18.696815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:18.697724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:18.707044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:18.707968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:18.708855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:18.709613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:18.761369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:18.761807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:18.762429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lazy-loading 'fault' on Instance uuid 8da71e10-c64b-4ba4-9154-01b731052625 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:53:18.811687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:18.820629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-713eb47e-72c8-44de-9b53-f3b8749d284e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 200 len: 1303 microversion: 2.1 time: 0.131747 Jun 17 12:53:18.830678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 119/266] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:18 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:19.166053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:19.167103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:19.179979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:19.180694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:19.182900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:19.183349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:19.256283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1470da29-cd03-46fb-93e2-41dbd9d547f7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Action: 'create', calling method: .version_select at 0x7f454ea628b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1048624945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBrgsEKhXVSjNs9lwhT4kYesopJcGpVc+b1IChca+K17X0+8BNPgfpMA7n51FbrRT4+jS8ZxRMr1jn49LIFojwKKTDjkb7jl54IzToJu/0zjqDCQIFX5h8oJCKFBeifdw=="}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:19.279748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-1470da29-cd03-46fb-93e2-41dbd9d547f7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Getting quotas for project 6eae9ef94ebe47e7a585d24d25930a82. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:53:19.284774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-1470da29-cd03-46fb-93e2-41dbd9d547f7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Getting quotas for user 0549a0df5e204b2b97bdcf4c745042c7 and project 6eae9ef94ebe47e7a585d24d25930a82. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:53:19.325687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1470da29-cd03-46fb-93e2-41dbd9d547f7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.370926 Jun 17 12:53:19.326450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 148/267] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 12:53:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:19.452250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:19.461167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c8a66b67-2d43-42a5-90e5-0c30ad45efc3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.298923 Jun 17 12:53:19.461763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 120/268] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:19 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:19.838773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:19.840366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 8da71e10-c64b-4ba4-9154-01b731052625] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:19.848803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:19.849408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:19.850571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:19.851059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:19.867399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] HTTP exception thrown: Instance 8da71e10-c64b-4ba4-9154-01b731052625 could not be found. Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Request method failure captured: Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 HTTP/1.1 Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHkgfv2QG-GqOYP0cSKbGH0hbT6ruWeBvg0tfWmof_ORQ2DeFuo-l4yjJ2bLWIU_dbyT2LNBEV54L2X0F1d6UkaErnOoIza72ZAlVzKSKqY14NqU-1zE5-u4mcY9H8usoVv018LK_h0cybRqPsoTQV7ufmEHXsgv-39z15-wVmCqeuY Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: fd3e386b03924805aea83ba593c80d27 Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesActionsTest-234422233 Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 12:53:19.869099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fd3e386b03924805aea83ba593c80d27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fd3e386b03924805aea83ba593c80d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fd3e386b03924805aea83ba593c80d27", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fd3e386b03924805aea83ba593c80d27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesActionsTest-234422233 Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: fd3e386b03924805aea83ba593c80d27 Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesActionsTest-234422233 Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesActionsTest-234422233-project Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: fafe1438091c4f6db0c7087a8b215127 Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesActionsTest-234422233-project Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 8da71e10-c64b-4ba4-9154-01b731052625 could not be found. Jun 17 12:53:19.870481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '8da71e10-c64b-4ba4-9154-01b731052625'} Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da71e10-c64b-4ba4-9154-01b731052625 could not be found. Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:53:19.880814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da71e10-c64b-4ba4-9154-01b731052625 could not be found. Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da71e10-c64b-4ba4-9154-01b731052625 could not be found. Jun 17 12:53:19.882293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:19.884097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Returning 404 to user: Instance 8da71e10-c64b-4ba4-9154-01b731052625 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:53:19.884097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f19ab475-c598-4c56-86e6-d588dbca0a8d tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625" status: 404 len: 111 microversion: 2.1 time: 0.036438 Jun 17 12:53:19.884097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 149/269] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:19 2022] GET /compute/v2.1/servers/8da71e10-c64b-4ba4-9154-01b731052625 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 12:53:20.038478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-617636735", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "networks": [{"uuid": "6485a38a-cadf-45b4-9c4a-5ab5416734e5"}]}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:20.106330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] validate_networks() for [('6485a38a-cadf-45b4-9c4a-5ab5416734e5', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:53:20.483267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:20.484296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:20.492544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:20.493278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:20.494442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:20.494873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:20.714426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:20.722776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a40a658c-522d-451e-82dc-a959d30f3b46 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1520 microversion: 2.1 time: 0.247202 Jun 17 12:53:20.724228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 150/270] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:20 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:20.974840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:53:20.975322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:53:20.975837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:53:20.976240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:53:20.976645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:53:20.990704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:20.991316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:20.992467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:20.993096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:21.020861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Getting quotas for project fd3e386b03924805aea83ba593c80d27. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:53:21.025691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Getting quotas for user fafe1438091c4f6db0c7087a8b215127 and project fd3e386b03924805aea83ba593c80d27. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:53:21.062972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:53:21.065964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:53:21.187619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e48edfc6-1088-4a7b-ac8d-38161e1ed794 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150846 Jun 17 12:53:21.189794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 121/271] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:53:21.200973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0dcbe877-cf01-44a4-b3a1-dcded7d9fe7f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:21.201596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0dcbe877-cf01-44a4-b3a1-dcded7d9fe7f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:21.287110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0dcbe877-cf01-44a4-b3a1-dcded7d9fe7f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:21.294900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0dcbe877-cf01-44a4-b3a1-dcded7d9fe7f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1213 microversion: 2.1 time: 0.098110 Jun 17 12:53:21.298372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 151/272] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:21 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:21.753084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:21.754027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:21.761928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:21.762532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:21.763470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:21.764004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:21.908713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:21.918400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-838341e8-add5-4bcf-bb18-29664f06f151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1500 microversion: 2.1 time: 0.175941 Jun 17 12:53:21.931536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 122/273] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:21 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1500 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:21.936562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:21.937169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:21.944060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:21.944514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:21.945400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:21.945784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:22.102518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:22.110441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-56b0d09a-b973-4a2e-adc3-7b10d290c3ed tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1514 microversion: 2.1 time: 0.177806 Jun 17 12:53:22.111008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 152/274] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:21 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:22.316059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:22.316769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:22.324143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:22.324663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:22.325549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:22.326198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:22.405272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:22.416713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cb4ee6d8-9c20-4cee-ae9f-3db7b5db98fa tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1265 microversion: 2.1 time: 0.105092 Jun 17 12:53:22.417498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 123/275] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:22 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:23.442630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:23.443910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:23.450450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:23.451123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:23.452140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:23.452634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:23.570056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:23.571086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:23.578007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:23.578684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:23.579497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:23.579934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:23.617244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'flavor' on Instance uuid 05d77c9b-4a5f-469d-9a72-ced7b26a4138 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:53:23.631144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:23.639877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2bbd8542-0c4d-40d7-beb4-2e0356eb69bf tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.201454 Jun 17 12:53:23.646187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 153/276] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:23 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:23.739449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-637b9ef2-13ee-49d9-9419-b11412379617 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138/action" status: 200 len: 32 microversion: 2.1 time: 0.174189 Jun 17 12:53:23.740365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 124/277] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:53:23 2022] POST /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 12:53:23.750391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:23.750811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:23.758051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:23.758520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:23.759417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:23.760017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:23.949837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:23.954378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-d10c54b6-f09f-414d-96c9-6d970eb55ca3 req-944d9998-c070-43ee-96f5-a1eef2fa5b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a88ebf-eb63-4518-a1c3-21fc0b9d3021", "tag": "0d7095f0-1b26-4c3d-8741-d559c22dbe1d"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:23.965108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-d10c54b6-f09f-414d-96c9-6d970eb55ca3 req-944d9998-c070-43ee-96f5-a1eef2fa5b27 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:23.965839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-d10c54b6-f09f-414d-96c9-6d970eb55ca3 req-944d9998-c070-43ee-96f5-a1eef2fa5b27 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:23.975065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-69e41d71-1807-4994-bfe7-91d0b6ef7ce8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.228867 Jun 17 12:53:23.977666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 154/278] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:23 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:23.989614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-d10c54b6-f09f-414d-96c9-6d970eb55ca3 req-944d9998-c070-43ee-96f5-a1eef2fa5b27 service nova] Creating event network-changed:0d7095f0-1b26-4c3d-8741-d559c22dbe1d for instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 on hv-cinder-84617 Jun 17 12:53:24.000013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-d10c54b6-f09f-414d-96c9-6d970eb55ca3 req-944d9998-c070-43ee-96f5-a1eef2fa5b27 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046680 Jun 17 12:53:24.001952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 125/279] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:53:24.661509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:24.662236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:24.671063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:24.671536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:24.672468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:24.673058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:24.862255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:24.872629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be1e4e19-86e6-47cd-bbfd-d3163e41ad43 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.215016 Jun 17 12:53:24.873320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 155/280] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:24 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:24.995756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:24.998976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:25.007849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:25.008407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:25.009218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:25.009647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:25.249764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:25.261517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c39df19e-13d5-42e5-84f5-1ec07423f7e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.270432 Jun 17 12:53:25.263487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 126/281] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:24 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:25.891418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:25.892002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:25.894064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:25.900212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:25.900660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:25.901503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:25.901923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:25.907562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:26.050501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:26.065051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe934217-e553-4c68-b6cf-1df65d815b82 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.177579 Jun 17 12:53:26.065801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 156/282] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:25 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:26.281914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:26.283212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:26.289672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:26.290110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:26.295631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:26.296177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:26.459692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:26.467356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c601d9f7-b215-42ff-a174-3cd5691f264c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.190763 Jun 17 12:53:26.467991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 127/283] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:26 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:27.082189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:27.082807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:27.089668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:27.090100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:27.090861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:27.091286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:27.228329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:27.236317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4e8aa897-0c30-456e-840b-ff15df97d52f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.157871 Jun 17 12:53:27.236881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 157/284] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:27 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:27.484908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:27.485381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:27.491938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:27.492372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:27.493136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:27.493733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:27.626818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:27.634945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62778619-931c-4ce6-8c37-cdb7d3d29a17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.154118 Jun 17 12:53:27.635975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 128/285] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:27 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:28.254169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:28.254765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:28.261057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:28.261489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:28.262243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:28.262662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:28.399929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:28.407649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-93244285-d03d-49cc-9eb8-8c76498ce135 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.157466 Jun 17 12:53:28.408238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 158/286] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:28 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:28.654248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:28.654865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:28.662003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:28.662447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:28.663218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:28.663691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:28.667827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:28.876861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:28.886502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-963570f6-4cfc-491c-af17-9f4edb3f9d80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.236262 Jun 17 12:53:28.887086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 129/287] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:28 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:29.389335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-73d3c8a4-cdca-418d-bfbf-103a5a62452b req-f81ad332-be4e-42fe-a12d-bbf4d04b7382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a88ebf-eb63-4518-a1c3-21fc0b9d3021", "name": "network-vif-plugged", "status": "completed", "tag": "0d7095f0-1b26-4c3d-8741-d559c22dbe1d"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:29.397712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-73d3c8a4-cdca-418d-bfbf-103a5a62452b req-f81ad332-be4e-42fe-a12d-bbf4d04b7382 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:29.398124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-73d3c8a4-cdca-418d-bfbf-103a5a62452b req-f81ad332-be4e-42fe-a12d-bbf4d04b7382 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:29.410461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-73d3c8a4-cdca-418d-bfbf-103a5a62452b req-f81ad332-be4e-42fe-a12d-bbf4d04b7382 service nova] Creating event network-vif-plugged:0d7095f0-1b26-4c3d-8741-d559c22dbe1d for instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 on hv-cinder-84617 Jun 17 12:53:29.415339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-73d3c8a4-cdca-418d-bfbf-103a5a62452b req-f81ad332-be4e-42fe-a12d-bbf4d04b7382 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029763 Jun 17 12:53:29.416123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 159/288] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:29.426353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:29.427154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:29.429897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:29.437642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:29.438119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:29.439067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:29.439544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:29.613352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:29.623406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34991a07-197e-4326-967f-de67959c8128 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.202083 Jun 17 12:53:29.623968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 130/289] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:29 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:29.904819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:29.905677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:29.912475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:29.912964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:29.913754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:29.914188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:30.292738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:30.300335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a89ed8cc-4c6a-4f86-90ed-95253db24260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.399919 Jun 17 12:53:30.300879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 160/290] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:29 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:30.640614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:30.641155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:30.648391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:30.648833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:30.649591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:30.650019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:30.791954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:30.799714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-848efe8b-2ebc-43e7-a87c-60819675d596 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.163130 Jun 17 12:53:30.800267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 131/291] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:30 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:31.317474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:31.318076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:31.320198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=6 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:31.325150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:31.325626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:31.326387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:31.327002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:31.463128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:31.472657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-421af420-e919-4037-9b55-e743e32cd3bb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.158768 Jun 17 12:53:31.473296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 161/292] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:31 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:31.818501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:31.819117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:31.821217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:31.821968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=6 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:31.828647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:31.829098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:31.829863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:31.830293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:31.976673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:31.984560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2b369d98-ad92-4642-a290-cd6aaf1c692f tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1313 microversion: 2.1 time: 0.170089 Jun 17 12:53:31.985126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 132/293] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:31 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:32.375428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-895540510", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-82634216", "security_groups": [{"name": "tempest-secgroup-smoke-398174429"}], "networks": [{"uuid": "c27baf47-4e2c-409b-9da0-09af97089b22"}], "block_device_mapping_v2": [{"uuid": "3ac60a4e-f783-4994-9204-8a2a9c826c43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:32.489954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:32.490599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:32.498541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:32.498988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:32.499790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:32.500388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:32.503572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] validate_networks() for [('c27baf47-4e2c-409b-9da0-09af97089b22', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:53:32.646596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:32.654648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fc0fb057-c37f-4e3e-9ccb-a9a2c2608428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.168640 Jun 17 12:53:32.655256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 133/294] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:32 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:32.902387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:53:32.903026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:53:32.903530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:53:32.903923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:53:32.904322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:53:32.914700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:32.915124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:32.915947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:32.916369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:32.935037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Getting quotas for project 3b5f6238effd43d39cbf0af0f4c582f8. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:53:32.939716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Getting quotas for user 109a46a7108e48c48407681b3e5b1e0c and project 3b5f6238effd43d39cbf0af0f4c582f8. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:53:32.999458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:53:33.001484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ac60a4e-f783-4994-9204-8a2a9c826c43',volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:53:33.002064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:33.002651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:33.014736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.014736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:33.014736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.014736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:33.162169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:33.166297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-153636b9-60f0-499b-b6aa-2a1e731848ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796918 Jun 17 12:53:33.167012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 162/295] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:53:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:53:33.171149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4cc9951c-dc8d-4796-b4a5-e866dd13fea2 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1498 microversion: 2.1 time: 0.172929 Jun 17 12:53:33.171743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 134/296] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:32 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:33.185220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-09ac66c8-9e40-4c03-bfaf-d08af073333a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:33.186006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-09ac66c8-9e40-4c03-bfaf-d08af073333a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:33.252489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-09ac66c8-9e40-4c03-bfaf-d08af073333a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:33.259715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-09ac66c8-9e40-4c03-bfaf-d08af073333a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1086 microversion: 2.1 time: 0.078801 Jun 17 12:53:33.260285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 163/297] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1086 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:33.673771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:33.684719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:33.696845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.698051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:33.699053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.699705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:33.734091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:33.734572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:33.751441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.752935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:33.754279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.754872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:33.803209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 12:53:33.864292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:33.872887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-25a4d0b3-e315-41ed-8ee5-3e6bee943b71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.204752 Jun 17 12:53:33.874806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 135/298] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:33 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:33.899963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-de407e2a-6726-4d8a-8356-4b29318f2e88 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "DELETE /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 204 len: 0 microversion: 2.1 time: 0.169622 Jun 17 12:53:33.900629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 164/299] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 12:53:33 2022] DELETE /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:53:33.909191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:33.909910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:33.917016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.917530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:33.918582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:33.919035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:34.068644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:34.077099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a269f5a4-c9e7-49cd-b2a6-696968970da7 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1504 microversion: 2.1 time: 0.171804 Jun 17 12:53:34.077652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 136/300] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:33 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:34.281824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:34.282969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:34.291740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:34.292189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:34.292946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:34.293376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:34.356263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:34.364233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-13fd0648-b550-423a-8d1e-291ab0f1bc8c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1184 microversion: 2.1 time: 0.089638 Jun 17 12:53:34.364786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 165/301] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1184 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:34.895912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:34.896905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:34.905232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:34.905670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:34.906418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:34.906842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:35.096716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:35.097317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:35.104122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:35.104684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:35.105642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:35.106077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:35.246546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:35.254358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-39a87a3a-0a95-4937-a272-73b2c4606b94 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1504 microversion: 2.1 time: 0.161947 Jun 17 12:53:35.254936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 166/302] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:35 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:35.285507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:35.293288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4e167db5-f804-4970-b305-b8b2b933e807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.403862 Jun 17 12:53:35.293841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 137/303] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:34 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:35.381685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:35.382422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:35.389254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:35.389695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:35.390478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:35.390903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:35.453483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:35.462025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cd5acbbb-6878-4515-9dea-69a47ef049cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1184 microversion: 2.1 time: 0.084246 Jun 17 12:53:35.462600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 167/304] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1184 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:36.277303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:36.277905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:36.284855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:36.285298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:36.286035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:36.286603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:36.310892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:36.311487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:36.317954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:36.318390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:36.319165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:36.319633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:36.424732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:36.432905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-db7fa494-dcf0-41d0-94c4-a0f259acb75b tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1504 microversion: 2.1 time: 0.162958 Jun 17 12:53:36.433490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 138/305] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:36 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:36.461040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:36.468661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-823bd2a2-03ce-48f1-9a91-128d8a5b44d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.162222 Jun 17 12:53:36.469213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 168/306] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:36 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:36.478970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:36.479619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:36.485998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:36.486439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:36.487192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:36.487642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:36.549847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:36.557692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-60e9efa2-940c-48c9-9525-937ef768baa6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1184 microversion: 2.1 time: 0.082510 Jun 17 12:53:36.558270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 139/307] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1184 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:37.451804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:37.452503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:37.459416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:37.459883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:37.460644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:37.461095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:37.486237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:37.486796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:37.494343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:37.494961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:37.495606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:37.496008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:37.607435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:37.615244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4960a0c4-4caa-4098-a684-e809ad596ee4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1504 microversion: 2.1 time: 0.168350 Jun 17 12:53:37.615856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 169/308] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:37 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:37.620344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:37.620941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:37.627115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:37.627593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:37.628643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:37.629074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:37.645266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:37.653100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d14c34ce-06d7-4f17-8e9d-ce6a8f239634 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.170746 Jun 17 12:53:37.653756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 140/309] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:37 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:37.691506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:37.698972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-edc7f111-ce44-408b-a544-78abdf7b4b43 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1184 microversion: 2.1 time: 0.082158 Jun 17 12:53:37.699760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 170/310] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1184 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:38.632476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:38.633121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:38.642209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:38.642923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:38.643892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:38.644431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:38.670082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:38.670748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:38.677572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:38.677873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:38.678661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:38.679083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:38.781249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:38.788996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3f4706cd-3580-481b-ba3d-7d20bcfa826e tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1504 microversion: 2.1 time: 0.160358 Jun 17 12:53:38.789553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 141/311] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:38 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:38.794439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:38.795621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:38.801329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:38.801779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:38.802552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:38.802982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:38.810752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:38.818509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2184d840-b10a-4c38-9f9d-51e36542be94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.152808 Jun 17 12:53:38.819104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 171/312] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:38 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:38.863401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:38.870931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-67548d18-ae54-49e2-9f58-7dd11e115173 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1184 microversion: 2.1 time: 0.080406 Jun 17 12:53:38.871516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 142/313] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1184 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:39.807147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-23ea5ffc-27c6-4422-bb57-f6315ce7c0c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:39.808160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-23ea5ffc-27c6-4422-bb57-f6315ce7c0c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:39.810247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:39.810964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:39.818240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23ea5ffc-27c6-4422-bb57-f6315ce7c0c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:39.819110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23ea5ffc-27c6-4422-bb57-f6315ce7c0c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:39.820256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23ea5ffc-27c6-4422-bb57-f6315ce7c0c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:39.820986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23ea5ffc-27c6-4422-bb57-f6315ce7c0c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:39.822570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:39.823364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:39.824657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:39.825381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:39.846372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-23ea5ffc-27c6-4422-bb57-f6315ce7c0c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/ips" status: 200 len: 153 microversion: 2.20 time: 0.046199 Jun 17 12:53:39.847619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 172/314] 10.222.0.87 () {60 vars in 1288 bytes} [Fri Jun 17 12:53:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:53:39.856330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:39.857503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:39.863865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:39.864346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:39.865083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:39.865506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:39.981593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:39.990676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c6a890de-c657-4c91-a6d3-2c12b79658a8 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1504 microversion: 2.1 time: 0.187151 Jun 17 12:53:39.991255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 143/315] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:39 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:39.996232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:39.997531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:40.003623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:40.004148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:40.004997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:40.005701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:40.009749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:40.017270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:40.020861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a3088ec-149f-4373-a931-08538a52af57 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.172418 Jun 17 12:53:40.021584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 173/316] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:39 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:40.068093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:40.075798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ba4d865f-93d1-48cf-b4b3-4ef7ebc7ae6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1184 microversion: 2.1 time: 0.083246 Jun 17 12:53:40.076372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 144/317] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1184 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:41.008670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:41.009927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:41.018393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.019340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.020196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.020799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.040930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:41.042408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:41.051298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.051846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.052949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.053436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.173802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:41.183209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fc67b9eb-7021-4d3f-9117-49bb6ab6dcfd tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1504 microversion: 2.1 time: 0.179363 Jun 17 12:53:41.193247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 174/318] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:41 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:41.193247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:41.193247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:41.198167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.198658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.199616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.200097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.269885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:41.282128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9cea0cc8-f04e-40ee-9124-592e748e5b13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1202 microversion: 2.1 time: 0.096509 Jun 17 12:53:41.282724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 175/319] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:41.386969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:41.387159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-f06d2b68-09c7-42a2-a893-d3638ba072ab req-489d977e-5973-47fd-ad63-cbf9684cf112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a88ebf-eb63-4518-a1c3-21fc0b9d3021", "name": "network-vif-unplugged", "status": "completed", "tag": "0d7095f0-1b26-4c3d-8741-d559c22dbe1d"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:41.393205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:41.397029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-f06d2b68-09c7-42a2-a893-d3638ba072ab req-489d977e-5973-47fd-ad63-cbf9684cf112 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.397568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-f06d2b68-09c7-42a2-a893-d3638ba072ab req-489d977e-5973-47fd-ad63-cbf9684cf112 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.400939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc0918a8-ad59-438a-9335-2123fd3cff94 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.366055 Jun 17 12:53:41.416534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 145/320] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:41 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:41.417488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-f06d2b68-09c7-42a2-a893-d3638ba072ab req-489d977e-5973-47fd-ad63-cbf9684cf112 service nova] Creating event network-vif-unplugged:0d7095f0-1b26-4c3d-8741-d559c22dbe1d for instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 on hv-cinder-84617 Jun 17 12:53:41.424166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-f06d2b68-09c7-42a2-a893-d3638ba072ab req-489d977e-5973-47fd-ad63-cbf9684cf112 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041496 Jun 17 12:53:41.425212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 176/321] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:41.725579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-e1db46a8-cc6f-45ac-b870-dba847a26f95 req-c50fb161-35e8-4494-b73a-37dc35a49085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a88ebf-eb63-4518-a1c3-21fc0b9d3021", "name": "network-vif-deleted", "tag": "0d7095f0-1b26-4c3d-8741-d559c22dbe1d"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:41.735209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-e1db46a8-cc6f-45ac-b870-dba847a26f95 req-c50fb161-35e8-4494-b73a-37dc35a49085 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:41.735738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-e1db46a8-cc6f-45ac-b870-dba847a26f95 req-c50fb161-35e8-4494-b73a-37dc35a49085 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:41.747660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-e1db46a8-cc6f-45ac-b870-dba847a26f95 req-c50fb161-35e8-4494-b73a-37dc35a49085 service nova] Creating event network-vif-deleted:0d7095f0-1b26-4c3d-8741-d559c22dbe1d for instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 on hv-cinder-84617 Jun 17 12:53:41.753889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-e1db46a8-cc6f-45ac-b870-dba847a26f95 req-c50fb161-35e8-4494-b73a-37dc35a49085 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032566 Jun 17 12:53:41.754853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 146/322] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:53:42.203853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:42.204622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:42.215656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.216295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.217382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.218435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.273966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.284190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.285118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lazy-loading 'fault' on Instance uuid 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:53:42.300558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:42.301454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:42.327305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.327939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.329087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.329728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.390244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafe1438091c4f6db0c7087a8b215127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e386b03924805aea83ba593c80d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:42.400946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-58b5c1f0-9e31-442d-b903-fc13d74a53ed tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 200 len: 1303 microversion: 2.1 time: 0.203458 Jun 17 12:53:42.401921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 177/323] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:42 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 1303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:42.420664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:42.423294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:42.431265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.431265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.431705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.432130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.618179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:42.628223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:42.629737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4f258d02-af58-4800-9ff7-a64c2e521396 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.213329 Jun 17 12:53:42.631082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 178/324] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:42 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:42.641664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8c8a5f7e-e132-4586-abef-a2bd732284fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1269 microversion: 2.1 time: 0.346242 Jun 17 12:53:42.651240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 147/325] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1269 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:42.972693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:42.973567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:42.975831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:42.981517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.981959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:42.982743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:42.983166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.027118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lazy-loading 'flavor' on Instance uuid a700d72f-235d-44b5-a1e5-45ba058ebc43 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:53:43.258597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=8 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:43.332017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3f8bdc36-082a-4fc8-bd88-36a9c8a5830a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/action" status: 202 len: 0 microversion: 2.20 time: 0.363669 Jun 17 12:53:43.335659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 179/326] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Jun 17 12:53:42 2022] POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 12:53:43.342032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:43.343236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:43.350239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.350686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.351501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.351962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.419081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:43.419789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] [instance: 88a88ebf-eb63-4518-a1c3-21fc0b9d3021] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:43.426675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.427123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.427926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.428347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.442852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] HTTP exception thrown: Instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 could not be found. Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Request method failure captured: Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 HTTP/1.1 Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHkgfv2QG-GqOYP0cSKbGH0hbT6ruWeBvg0tfWmof_ORQ2DeFuo-l4yjJ2bLWIU_dbyT2LNBEV54L2X0F1d6UkaErnOoIza72ZAlVzKSKqY14NqU-1zE5-u4mcY9H8usoVv018LK_h0cybRqPsoTQV7ufmEHXsgv-39z15-wVmCqeuY Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: fd3e386b03924805aea83ba593c80d27 Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesActionsTest-234422233 Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 12:53:43.444828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fd3e386b03924805aea83ba593c80d27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/fd3e386b03924805aea83ba593c80d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_fd3e386b03924805aea83ba593c80d27", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/fd3e386b03924805aea83ba593c80d27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesActionsTest-234422233 Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: fd3e386b03924805aea83ba593c80d27 Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesActionsTest-234422233 Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesActionsTest-234422233-project Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: fafe1438091c4f6db0c7087a8b215127 Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesActionsTest-234422233-project Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 could not be found. Jun 17 12:53:43.446171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '88a88ebf-eb63-4518-a1c3-21fc0b9d3021'} Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 could not be found. Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:53:43.446898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 could not be found. Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 could not be found. Jun 17 12:53:43.448134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:53:43.449149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] Returning 404 to user: Instance 88a88ebf-eb63-4518-a1c3-21fc0b9d3021 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:53:43.449149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-867fcc86-513c-4447-9405-fdf8ca43f8e4 tempest-VolumesActionsTest-234422233 tempest-VolumesActionsTest-234422233-project] 10.222.0.87 "GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021" status: 404 len: 111 microversion: 2.1 time: 0.031973 Jun 17 12:53:43.449149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 180/327] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:43 2022] GET /compute/v2.1/servers/88a88ebf-eb63-4518-a1c3-21fc0b9d3021 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 12:53:43.556239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:43.564873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:43.566371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:43.567526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-94ca6403-5d43-4f4a-abab-4ddffec4943a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.230227 Jun 17 12:53:43.568410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 148/328] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:43.647015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:43.647725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:43.658579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:43.659510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:43.671698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.671698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.671698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.671698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.672063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.672063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.672063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.672063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.846378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:43.848356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:43.856728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6c6c9fd8-b47b-4bd7-9a73-2fff0615cfef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.202439 Jun 17 12:53:43.857328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 149/329] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:43.862191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-7dd74bf4-38d6-4e3e-b911-73ebcb515488 req-92287fa9-d622-493e-9654-de0f521a650b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e78628d-5386-4d24-adb0-9ea06bce2e6f", "tag": "f207d69b-630e-4aae-8a6c-17febe0a96eb"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:43.867700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a26a8756-7855-4fa4-8507-72d785cdce77 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.214806 Jun 17 12:53:43.868344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 181/330] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:43 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:43.870556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-7dd74bf4-38d6-4e3e-b911-73ebcb515488 req-92287fa9-d622-493e-9654-de0f521a650b service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:43.871172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-7dd74bf4-38d6-4e3e-b911-73ebcb515488 req-92287fa9-d622-493e-9654-de0f521a650b service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:43.887391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-7dd74bf4-38d6-4e3e-b911-73ebcb515488 req-92287fa9-d622-493e-9654-de0f521a650b service nova] Creating event network-changed:f207d69b-630e-4aae-8a6c-17febe0a96eb for instance 7e78628d-5386-4d24-adb0-9ea06bce2e6f on hv-cinder-84617 Jun 17 12:53:43.896509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-7dd74bf4-38d6-4e3e-b911-73ebcb515488 req-92287fa9-d622-493e-9654-de0f521a650b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037760 Jun 17 12:53:43.900319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 150/331] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:44.587916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:44.588530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:44.595484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:44.595985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:44.596751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:44.597543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:44.741469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:44.749938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:44.751428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:44.752601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be682d0c-d511-4a4a-aedd-05b5702b81ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.168905 Jun 17 12:53:44.753164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 182/332] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:44.880156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:44.881070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:44.889311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:44.889923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:44.890941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:44.891401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:44.892191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:44.892632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:44.896272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:44.896716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:44.897764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:44.898204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:45.029160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:45.034718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:45.036972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-73fc3579-b97a-4a9a-b3dc-2cfde92c33d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.165001 Jun 17 12:53:45.037539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 151/333] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:45.042287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c093f00a-3d25-44c3-894c-9a73cd70d64c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.160065 Jun 17 12:53:45.042918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 183/334] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:44 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:45.775719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:45.776729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:45.787440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:45.788237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:45.789487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:45.790204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:45.922338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:45.932062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:45.933572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:45.934736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-60d0a958-30ac-4e78-a1b8-3a39acf3689d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.166040 Jun 17 12:53:45.935289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 152/335] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:46.053917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:46.054514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:46.059311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:46.059949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:46.061212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:46.061956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:46.062702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:46.063152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:46.066242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:46.066688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:46.067479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:46.067900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:46.199412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:46.201903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:46.207394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6c5117da-d779-4c92-ae50-683575799547 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.157342 Jun 17 12:53:46.207995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 184/336] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:46.209918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-079ee380-7a76-4ac4-8dfa-b910d45dfb38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.154410 Jun 17 12:53:46.210468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 153/337] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:46 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:46.954247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:46.954842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:46.961424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:46.961872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:46.962604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:46.963024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:47.099460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:47.107703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:47.109259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:47.110888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1acfbf80-4086-4c48-9bfc-7e79b5a69fb4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.161253 Jun 17 12:53:47.111462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 185/338] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:47.165677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0d2cb186-381e-4bf6-ab63-32b92e6f4709 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:47.166202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d2cb186-381e-4bf6-ab63-32b92e6f4709 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:47.173388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d2cb186-381e-4bf6-ab63-32b92e6f4709 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:47.173832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d2cb186-381e-4bf6-ab63-32b92e6f4709 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:47.174597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d2cb186-381e-4bf6-ab63-32b92e6f4709 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:47.175030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d2cb186-381e-4bf6-ab63-32b92e6f4709 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:47.198725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0d2cb186-381e-4bf6-ab63-32b92e6f4709 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/ips" status: 200 len: 149 microversion: 2.1 time: 0.036896 Jun 17 12:53:47.199236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 154/339] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 12:53:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:47.224992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:47.225746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:47.227257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:47.228011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:47.232356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:47.232893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:47.234327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:47.234469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:47.234780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:47.235175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:47.235611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:47.236028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:47.376328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:47.386620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5ffb7eec-fa03-444f-814b-1f3c9bedaa20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.165749 Jun 17 12:53:47.391459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 186/340] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:47.391652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:47.400517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d514493a-cef6-4548-a7f6-ac1b7b683356 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.176941 Jun 17 12:53:47.410585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 155/341] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:47 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:48.129554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:48.130133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:48.136537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.136984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.137771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.138197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.272134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:48.280765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:48.282296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:48.283444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7bc3367b-56de-43a5-bd72-7e59429e84d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.157867 Jun 17 12:53:48.283997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 187/342] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:48.403977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:48.404580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:48.411699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.412359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.413136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.413567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.417167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:48.417862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:48.424353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.424801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.425567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.425972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.553640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:48.558942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:48.565328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1ad3ce3c-8f32-4223-9677-950cbd87c0fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.165583 Jun 17 12:53:48.565899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 156/343] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:48.566646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-48a43109-db16-4e66-ba63-d8fce8861539 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.153349 Jun 17 12:53:48.567406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 188/344] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:48 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:48.610504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f71fb06-c9f2-4205-a09d-aa34363a3bf5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55fae383-05f4-4526-b7f3-e026b6860d6c"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:48.611676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f71fb06-c9f2-4205-a09d-aa34363a3bf5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:48.617864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f71fb06-c9f2-4205-a09d-aa34363a3bf5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.618314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f71fb06-c9f2-4205-a09d-aa34363a3bf5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.619074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f71fb06-c9f2-4205-a09d-aa34363a3bf5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:48.619551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f71fb06-c9f2-4205-a09d-aa34363a3bf5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:48.895415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f71fb06-c9f2-4205-a09d-aa34363a3bf5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288712 Jun 17 12:53:48.900737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 157/345] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 12:53:48 2022] POST /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:49.302009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:49.302613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:49.309262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.309925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:49.310857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.311554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:49.324013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2062357566", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1048624945", "security_groups": [{"name": "tempest-secgroup-smoke-1784971003"}], "block_device_mapping_v2": [{"uuid": "5855a8fd-1413-47c9-b0b0-60437fbea262", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6731f394-dd14-4b07-ad91-ba8e0da29052"}]}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:49.338656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:49.499121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:49.509548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] validate_networks() for [('6731f394-dd14-4b07-ad91-ba8e0da29052', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:53:49.510118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:49.511165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:49.512385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-75e9ff43-5785-4a87-acb7-9ada64757b43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.214237 Jun 17 12:53:49.512956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 189/346] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:49.589549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:49.590467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:49.600797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.601506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:49.602290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.602906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:49.773853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:49.783476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-44c567c5-887c-4897-b4ac-c61e2a0c9cbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.199659 Jun 17 12:53:49.784330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 190/347] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:49.789167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:49.789770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:49.796436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.797331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:49.799069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.799789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:49.956806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:49.965046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c5344e46-6141-44ff-8873-95700f43a36e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.179393 Jun 17 12:53:49.968715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 191/348] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:49 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:49.975404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ca593cca-f4b9-41e2-959d-cafaf2d0ad80 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:49.976299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ca593cca-f4b9-41e2-959d-cafaf2d0ad80 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:49.986669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca593cca-f4b9-41e2-959d-cafaf2d0ad80 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.987451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca593cca-f4b9-41e2-959d-cafaf2d0ad80 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:49.988390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca593cca-f4b9-41e2-959d-cafaf2d0ad80 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:49.988974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca593cca-f4b9-41e2-959d-cafaf2d0ad80 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:50.015773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ca593cca-f4b9-41e2-959d-cafaf2d0ad80 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/ips" status: 200 len: 146 microversion: 2.1 time: 0.045425 Jun 17 12:53:50.016540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 192/349] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 12:53:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:50.232980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:53:50.233786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:53:50.234606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:53:50.235173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:53:50.235658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:53:50.244680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:50.245112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:50.245911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:50.246335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:50.264206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Getting quotas for project 6eae9ef94ebe47e7a585d24d25930a82. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:53:50.268865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Getting quotas for user 0549a0df5e204b2b97bdcf4c745042c7 and project 6eae9ef94ebe47e7a585d24d25930a82. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:53:50.329891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:53:50.332071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5855a8fd-1413-47c9-b0b0-60437fbea262',volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:53:50.524301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cfa530de-1c7a-4371-b801-23686170437a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.204894 Jun 17 12:53:50.525208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 158/350] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:53:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:53:50.536047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:50.536899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:50.549277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:50.550535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-04a31ab3-0322-4430-b1d7-ecbca9c1172f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:50.551492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-04a31ab3-0322-4430-b1d7-ecbca9c1172f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:50.552412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:50.553221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:50.554432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:50.555180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:50.641738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-04a31ab3-0322-4430-b1d7-ecbca9c1172f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:50.649766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-04a31ab3-0322-4430-b1d7-ecbca9c1172f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1095 microversion: 2.1 time: 0.107818 Jun 17 12:53:50.657714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 159/351] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1095 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:50.728553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:50.740085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:50.741865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:50.743515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fd7aea8d-16f3-4ec0-85a5-0d7a5cd3450a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.212498 Jun 17 12:53:50.744078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 193/352] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:50.804994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:50.805799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:50.826884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:50.827951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:50.829033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:50.830208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:50.986757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:50.987485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:51.000914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:51.002070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:51.005894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:51.007796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:51.042812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:51.052578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4010d91c-55d8-494c-842e-c78eb3fba609 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.255663 Jun 17 12:53:51.062806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 160/353] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:51.285645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:51.294631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4efeb970-e400-4350-8584-f6ea89fb4ff6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.312702 Jun 17 12:53:51.295364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 194/354] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:50 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:51.672087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:51.673088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:51.684549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:51.685274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:51.686558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:51.688426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:51.760209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:51.763457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:51.764086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:51.768221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9c1d9041-bce2-4fc6-a5bf-847de28d74f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1145 microversion: 2.1 time: 0.103021 Jun 17 12:53:51.768815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 161/355] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:51 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:51.770751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:51.771269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:51.772123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:51.772663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:51.909720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:51.918366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:51.920025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:51.921265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-406a4f18-7b01-43cf-b178-4e6b469c0cc4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.161610 Jun 17 12:53:51.922178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 195/356] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:53:52.070066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:52.070591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:52.077507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.078209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:52.079010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.079500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:52.219686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:52.227871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ad84ebe-10c6-45fe-a3ef-60a345cdca57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.162098 Jun 17 12:53:52.228409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 162/357] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:52.314008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:52.314607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:52.321014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.321386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:52.322127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.322545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:52.475888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:52.486432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30dc6f60-1705-48dd-b5da-b8b5c67784c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.178183 Jun 17 12:53:52.487629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 196/358] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:52 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:52.784953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:52.785567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:52.792780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.793272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:52.794041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.794648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:52.921674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:52.941037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:52.942411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:52.956986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8fb27d74-36ca-4870-a7cd-9bd6aa892d69 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1145 microversion: 2.1 time: 0.174385 Jun 17 12:53:52.957968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 163/359] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1145 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:52.959296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.960831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:52.962684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:52.963829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.155015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:53.165062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:53.167229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:53.168512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-77ec5009-664c-420e-bbe6-fe8f9c93318c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.232267 Jun 17 12:53:53.169150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 197/360] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:53.244829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:53.246310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:53.252947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.253303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.254089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.254503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.278717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:53.416118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-586e0fad-841d-4e37-a1db-4ad03d34306d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16419ea1-b948-4f34-a5ec-589be8aff045"}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:53.418117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-586e0fad-841d-4e37-a1db-4ad03d34306d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:53.428756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-586e0fad-841d-4e37-a1db-4ad03d34306d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.429390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-586e0fad-841d-4e37-a1db-4ad03d34306d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.430499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-586e0fad-841d-4e37-a1db-4ad03d34306d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.431071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-586e0fad-841d-4e37-a1db-4ad03d34306d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.483848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:53.494632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-90808b62-6743-4f25-972c-e28aa4e45a21 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.253679 Jun 17 12:53:53.506253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 164/361] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:53.511347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:53.512058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:53.519047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.519527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.520425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.520864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.728785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:53.737016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f7474cd2-6d01-48f9-8512-f55f916c1483 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.229607 Jun 17 12:53:53.737780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 165/362] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:53 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:53.977888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:53.978769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:53.986308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.987033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:53.989155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:53.989750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:54.067225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:54.076324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-16e28f1a-feeb-45b9-9f03-2320ce0fae50 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1137 microversion: 2.1 time: 0.103494 Jun 17 12:53:54.077120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 166/363] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:53 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1137 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:54.192924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:54.193795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:54.201593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:54.203179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:54.204357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:54.204978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:54.449341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:54.459205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:54.461295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:54.462840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-93489261-ea8f-4e6c-affe-9e25e9503d3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.276114 Jun 17 12:53:54.463363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 167/364] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:54.513075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:54.513684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:54.525858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:54.527725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:54.530442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:54.531130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:54.553359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-586e0fad-841d-4e37-a1db-4ad03d34306d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.150565 Jun 17 12:53:54.559178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 198/365] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 12:53:53 2022] POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 194 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:54.757221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:54.758641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:54.767158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:54.769369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:54.770036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:54.771032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:54.771873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:54.784820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c8eaa4d1-bf4e-4043-974f-5f94f22358d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.275825 Jun 17 12:53:54.785622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 168/366] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:54.943063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:54.974946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49e7bc0e-5472-4ae3-b1c6-d5eb125c9c0c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.222450 Jun 17 12:53:54.994350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 199/367] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:54 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:55.095746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:55.097257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:55.113626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:55.114052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:55.114846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:55.118794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:55.272287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:55.283665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f15547b2-1d40-4040-86bc-1dd3a861d19d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1211 microversion: 2.1 time: 0.192624 Jun 17 12:53:55.284441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 169/368] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:55 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:55.482181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:55.482777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:55.495589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:55.496932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:55.497952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:55.499239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:55.716945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:55.729652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:55.731725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:55.733194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d7257db7-bfdc-4ef7-80f0-97361e4b309d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.254950 Jun 17 12:53:55.734113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 200/369] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:55.803828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:55.804635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:55.818836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:55.819311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:55.823686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:55.826016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:55.993173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:55.994442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:56.006362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:56.007239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:56.008602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:56.009295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:56.073063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:56.086880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2356e78d-7f8a-4680-af08-92301da8c0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.288643 Jun 17 12:53:56.088183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 170/370] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:56.195000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:56.206176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-28f34ca6-6938-44cb-8d36-c875d3d84388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.214908 Jun 17 12:53:56.215791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 201/371] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:55 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:56.302339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:56.303821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:56.306185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:56.317563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:56.318012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:56.318779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:56.319202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:56.651683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:56.663855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-891ce774-9de1-47c9-b44d-7d17a6e4729d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.364360 Jun 17 12:53:56.667218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 171/372] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:56 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:53:56.759147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:56.760915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:56.769385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:56.770107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:56.771643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:56.772293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.096558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:57.104722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:57.105349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:57.119131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:57.121147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.121529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:57.121681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.122373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.122803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.123628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d1f7cfac-6212-48b4-8090-0a3d703b538a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.372197 Jun 17 12:53:57.124717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 202/373] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:53:57.224127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:57.224866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:57.237498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.240611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.243421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.244128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.365307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:57.378731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7588ffe8-17c4-4e65-878a-4e6bacbca1cf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.274880 Jun 17 12:53:57.406409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 172/374] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:57.597404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:57.616760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c80034d6-6e56-4f26-99ae-892a7f6446a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1500 microversion: 2.1 time: 0.397268 Jun 17 12:53:57.618047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 203/375] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:57 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1500 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:57.635151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "715140dc-ca4b-458c-8fb3-02ab40f5a276"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:57.636840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:57.644762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.646221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.647398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.648442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.686117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:57.687087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:57.740045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.742358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.750685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.751612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.770005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Cannot 'attach_volume' instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 while it is in vm_state rescued Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: POST /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138/os-volume_attachments HTTP/1.1 Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 74 Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 12:53:57.772183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {"volumeAttachment": {"volumeId": "715140dc-ca4b-458c-8fb3-02ab40f5a276"}} Jun 17 12:53:57.773567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Cannot 'attach_volume' instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 while it is in vm_state rescued Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': '05d77c9b-4a5f-469d-9a72-ced7b26a4138', 'body': {'volumeAttachment': {'volumeId': '715140dc-ca4b-458c-8fb3-02ab40f5a276'}}} Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:53:57.774380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 while it is in vm_state rescued Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:53:57.775635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:53:57.776749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:53:57.776749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:53:57.776749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 while it is in vm_state rescued Jun 17 12:53:57.776749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:53:57.783012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 409 to user: Cannot 'attach_volume' instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 while it is in vm_state rescued {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:53:57.789989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-814d7a81-ca66-4e53-8094-cc565fb44a7e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.159079 Jun 17 12:53:57.791309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 173/376] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 12:53:57 2022] POST /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138/os-volume_attachments => generated 152 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 12:53:57.812962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-98e92a95-0cfd-4fd4-ac3b-d6a2797462f1 req-73854b2f-12d9-40f0-a297-b1345807c2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e78628d-5386-4d24-adb0-9ea06bce2e6f", "name": "network-vif-plugged", "status": "completed", "tag": "f207d69b-630e-4aae-8a6c-17febe0a96eb"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:57.871998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-98e92a95-0cfd-4fd4-ac3b-d6a2797462f1 req-73854b2f-12d9-40f0-a297-b1345807c2d4 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.872737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-98e92a95-0cfd-4fd4-ac3b-d6a2797462f1 req-73854b2f-12d9-40f0-a297-b1345807c2d4 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.898962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-98e92a95-0cfd-4fd4-ac3b-d6a2797462f1 req-73854b2f-12d9-40f0-a297-b1345807c2d4 service nova] Creating event network-vif-plugged:f207d69b-630e-4aae-8a6c-17febe0a96eb for instance 7e78628d-5386-4d24-adb0-9ea06bce2e6f on hv-cinder-84617 Jun 17 12:53:57.905353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-98e92a95-0cfd-4fd4-ac3b-d6a2797462f1 req-73854b2f-12d9-40f0-a297-b1345807c2d4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112074 Jun 17 12:53:57.909180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 174/377] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:57.914943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed14d422-4889-42fc-b581-6c66815a3524 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:57.916497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed14d422-4889-42fc-b581-6c66815a3524 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:57.925059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed14d422-4889-42fc-b581-6c66815a3524 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.926094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed14d422-4889-42fc-b581-6c66815a3524 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:57.942451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed14d422-4889-42fc-b581-6c66815a3524 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:57.943951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed14d422-4889-42fc-b581-6c66815a3524 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.044032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed14d422-4889-42fc-b581-6c66815a3524 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138/action" status: 202 len: 0 microversion: 2.1 time: 0.133153 Jun 17 12:53:58.045082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 175/378] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:53:57 2022] POST /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:53:58.055005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:58.055754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:58.064998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:58.065727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.066530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:58.067233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.158789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:58.168406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fada1340-b0ba-4b51-b3a3-3c7be9837106 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.487681 Jun 17 12:53:58.173886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 204/379] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:57 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:58.178844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:58.179506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:58.193641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:58.194378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.195841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:58.196274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.200772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:58.480534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:58.492004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:58.493905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:58.495341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5efa6db3-f921-4429-a789-e3fb28f5a27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.320288 Jun 17 12:53:58.496311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 205/380] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:58.512386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-805d5e55-a6c3-429b-95b0-cde423d152fd req-719b1354-ef52-44b7-aab0-3d31822979fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556e3927-0db8-47b5-a3f0-f0338fd92dee", "tag": "70865a20-dd41-4701-9d32-dd973d8fd09d"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:53:58.522388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-805d5e55-a6c3-429b-95b0-cde423d152fd req-719b1354-ef52-44b7-aab0-3d31822979fd service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:58.523187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-805d5e55-a6c3-429b-95b0-cde423d152fd req-719b1354-ef52-44b7-aab0-3d31822979fd service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.541881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-805d5e55-a6c3-429b-95b0-cde423d152fd req-719b1354-ef52-44b7-aab0-3d31822979fd service nova] Creating event network-changed:70865a20-dd41-4701-9d32-dd973d8fd09d for instance 556e3927-0db8-47b5-a3f0-f0338fd92dee on hv-cinder-84617 Jun 17 12:53:58.547621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-805d5e55-a6c3-429b-95b0-cde423d152fd req-719b1354-ef52-44b7-aab0-3d31822979fd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038766 Jun 17 12:53:58.548927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 206/381] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:53:58.556363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:58.557504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:58.566239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:58.566829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.567776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:58.568327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:58.773729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:58.784872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9ecf8d94-a381-460c-8559-633a3f2ff47f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.234399 Jun 17 12:53:58.785443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 207/382] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:58.880376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:58.892989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-39f31bb9-e988-4195-8835-242d1fb32ac3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1508 microversion: 2.1 time: 0.842577 Jun 17 12:53:58.896140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 176/383] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:58 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1508 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:59.190123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:59.190728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:59.202183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.202840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:59.210692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.211139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:59.413861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:59.423015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3294958c-bd65-4943-9705-075363aaaac3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.236603 Jun 17 12:53:59.424215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 208/384] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:59 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:53:59.514634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:59.515242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:59.537554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.538011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:59.538798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.539233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:59.754118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:59.762908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:59.764788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:53:59.766900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f6b13dc8-7550-4a43-a416-e1430770782b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1725 microversion: 2.20 time: 0.255875 Jun 17 12:53:59.778598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 177/385] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:53:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:53:59.804832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:59.805677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:59.814703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.818611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:59.820000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.821070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:59.914956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:53:59.916129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:53:59.932139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.933393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:53:59.935129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:53:59.939502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:00.069403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:00.077807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c73db6f2-24fd-4c5e-967f-d7b129fdfd6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1257 microversion: 2.1 time: 0.278955 Jun 17 12:54:00.089041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 209/386] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:59 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1257 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:00.230184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:00.245171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-12525d82-597d-45e5-a3ac-6dae103a2fdc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1508 microversion: 2.1 time: 0.335468 Jun 17 12:54:00.248367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 178/387] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:53:59 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:00.440130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:00.441451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:00.455234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:00.456134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:00.457489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:00.458286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:00.680657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:00.695885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-92d6ef72-f234-4482-a7a1-272fbd8ca705 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.256639 Jun 17 12:54:00.713247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 210/388] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:00 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:00.789288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:00.790345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:00.794684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:00.803133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=8 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:00.831658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:00.851219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:00.852152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:00.852686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.096244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:01.096854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:01.105537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:01.108643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.109097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.109966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.110402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.126077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:01.127895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:01.129069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4633c979-10e2-4ff6-b4df-14b9f3492719 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1746 microversion: 2.20 time: 0.347671 Jun 17 12:54:01.147097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 179/389] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1746 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:01.265242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:01.266295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:01.278978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.279455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.281145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.282066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:01.283971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.298314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d8fa4846-f1e5-4755-94a5-5e26af421bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1441 microversion: 2.1 time: 0.206293 Jun 17 12:54:01.302586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 211/390] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1441 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:01.320994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:01.321976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:01.333294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.333970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.335339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.335813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.601170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:01.609318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8d1884ca-873b-4fac-b8fa-79e88ff64f6f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1508 microversion: 2.1 time: 0.348044 Jun 17 12:54:01.634402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 180/391] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:01 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:01.634980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:01.637174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d89834eb-004c-48a4-8bda-450796fd4bb0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1441 microversion: 2.1 time: 0.318916 Jun 17 12:54:01.638164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 212/392] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1441 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:01.716765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:01.717654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:01.727301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.728933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.733669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:01.734088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:01.741088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:02.092491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:02.102257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-87100e1a-d00c-4a1d-8d09-006c15211706 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.391487 Jun 17 12:54:02.103141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 181/393] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:01 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:02.147672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:02.148463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:02.164543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:02.165271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:02.166566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:02.167257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:02.511001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:02.519402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:02.521970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:02.531946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76e55918-1f78-4156-85dd-bff746162831 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1746 microversion: 2.20 time: 0.387828 Jun 17 12:54:02.533056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 213/394] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1746 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:02.628377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:02.629630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:02.642004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:02.643746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:02.646834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:02.647594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:02.866490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:02.877475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff4fd7db-3e66-4c73-9a72-df3217d83814 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1508 microversion: 2.1 time: 0.254642 Jun 17 12:54:02.878055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 182/395] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:02 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:03.120044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:03.120771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:03.130030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:03.131507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:03.132306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:03.134404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:03.552128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:03.553965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:03.564321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:03.566375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:03.567414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:03.568506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:03.570488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:03.572609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a9992773-2264-491d-8328-c6fe95a13868 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.456919 Jun 17 12:54:03.592805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 214/396] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:03 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:03.857288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-f25fdded-8519-4d42-82bc-04813a9741ac req-ce72a11b-7c1e-4e04-b30d-3e44ef4b00ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "name": "network-vif-plugged", "status": "completed", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:03.882435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-f25fdded-8519-4d42-82bc-04813a9741ac req-ce72a11b-7c1e-4e04-b30d-3e44ef4b00ab service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:03.884041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-f25fdded-8519-4d42-82bc-04813a9741ac req-ce72a11b-7c1e-4e04-b30d-3e44ef4b00ab service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:03.904175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:03.918001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:03.920747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:03.922456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fc8e3a14-4fb2-4e79-ad75-d10db28d2e56 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1746 microversion: 2.20 time: 0.376026 Jun 17 12:54:03.922649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-f25fdded-8519-4d42-82bc-04813a9741ac req-ce72a11b-7c1e-4e04-b30d-3e44ef4b00ab service nova] Creating event network-vif-plugged:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 12:54:03.925030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 183/397] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1746 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:03.932127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:03.933446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:03.941698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:03.942513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:03.944993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:03.945110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-f25fdded-8519-4d42-82bc-04813a9741ac req-ce72a11b-7c1e-4e04-b30d-3e44ef4b00ab service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092161 Jun 17 12:54:03.945650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 215/398] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:03.946392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:04.183105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:04.199021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff6170e7-9f18-4b20-a5ad-a83253b1a6ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1508 microversion: 2.1 time: 0.271391 Jun 17 12:54:04.201579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 184/399] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:03 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:04.398417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba5b6d77-9464-489b-baf6-bfa69471ee7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: .version_select at 0x7f454ea29c10>, body: {"keypair": {"name": "tempest-keypair-1718725434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9PM5KjzbW0Bt2F2TUjFzphyE+LlFpFPrKHV3Y3Oi5OJy7h+x5YF9S0a55BgUWUEtfGd0prPcahATax4rxZylmDXfZLQvl0X7lys+aMLAuWAcW7BkXrM4aXZtDGM0DNag=="}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:04.413532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-ba5b6d77-9464-489b-baf6-bfa69471ee7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:54:04.417974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-ba5b6d77-9464-489b-baf6-bfa69471ee7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:54:04.455003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ba5b6d77-9464-489b-baf6-bfa69471ee7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060509 Jun 17 12:54:04.456076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 216/400] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 12:54:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:04.593749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:04.594913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:04.608157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:04.608886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:04.612873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:04.615198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:04.945809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:04.947285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:04.965223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:04.965954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:04.967006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:04.967692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:05.155577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:05.166974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c02bf522-5840-467c-b2da-f169bbd3f6fb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.576983 Jun 17 12:54:05.167199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 185/401] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:04 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:05.218381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:05.219357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:05.235824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:05.239063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:05.239928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:05.240364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:05.527533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:05.541607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7f07173a-adb6-42a1-8448-af86bb72e59c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1514 microversion: 2.1 time: 0.327400 Jun 17 12:54:05.581882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 186/402] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:05 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:05.716756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:05.731354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:05.733009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:05.734249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1c4e92cc-5f07-426f-85a2-67b7e786371a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.794905 Jun 17 12:54:05.734932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 217/403] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:05.737364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-8f70e53e-df8d-4fe8-b102-8652b55d6bdd req-bfbc8a9b-e4d5-4a80-9f0c-dd461f6baca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e78628d-5386-4d24-adb0-9ea06bce2e6f", "tag": "f207d69b-630e-4aae-8a6c-17febe0a96eb"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:05.772517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-8f70e53e-df8d-4fe8-b102-8652b55d6bdd req-bfbc8a9b-e4d5-4a80-9f0c-dd461f6baca0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:05.772992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-8f70e53e-df8d-4fe8-b102-8652b55d6bdd req-bfbc8a9b-e4d5-4a80-9f0c-dd461f6baca0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:05.811355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-8f70e53e-df8d-4fe8-b102-8652b55d6bdd req-bfbc8a9b-e4d5-4a80-9f0c-dd461f6baca0 service nova] Creating event network-changed:f207d69b-630e-4aae-8a6c-17febe0a96eb for instance 7e78628d-5386-4d24-adb0-9ea06bce2e6f on hv-cinder-84617 Jun 17 12:54:05.850431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-8f70e53e-df8d-4fe8-b102-8652b55d6bdd req-bfbc8a9b-e4d5-4a80-9f0c-dd461f6baca0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119141 Jun 17 12:54:05.859136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 187/404] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:54:06.184134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:06.184742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:06.217240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:06.219032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:06.220821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:06.223803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:06.449757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:06.462359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8b5d39a2-3399-4bc4-9d77-0730549bf689 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.282089 Jun 17 12:54:06.478787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 218/405] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:06 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:06.791644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:06.793310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:06.815960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:06.816936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:06.818078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:06.818865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:07.281829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:07.294761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:07.300541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:07.303623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f063f4d-b732-48e5-abe3-4d150a885f40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.553843 Jun 17 12:54:07.305931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 188/406] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:07.347265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-99f8f173-79a1-4745-b5bf-65350088082c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'create', calling method: .version_select at 0x7f454ea08940>, body: {"keypair": {"name": "tempest-keypair-1986221162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnFCrpW6d2UNULCAJW1bqW0gxXgkkdQQS4CSirmKI3o5LGzq+QM1BPL6ukBFIyN2a5uysdNvO9t10dmW9eErdQrxIwO2s2rRavxBOq+cWAOIwwhpoU+3b9g/tHIhql3uA=="}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:07.380958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-99f8f173-79a1-4745-b5bf-65350088082c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for project 8ba886227347427bb1cbce939509be05. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:54:07.389613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-99f8f173-79a1-4745-b5bf-65350088082c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for user efee42b434cd47d99984b85f677983c2 and project 8ba886227347427bb1cbce939509be05. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:54:07.443023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-99f8f173-79a1-4745-b5bf-65350088082c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098808 Jun 17 12:54:07.444557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 219/407] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 12:54:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:07.487565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:07.488229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:07.502813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:07.505467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:07.506654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:07.507108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:07.748559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:07.761037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f6cd2297-8464-4615-87de-18b014fa6373 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.278553 Jun 17 12:54:07.762820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 189/408] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:07 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:08.329727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:08.330468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:08.340780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:08.341600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:08.343215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:08.343982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:08.533344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:08.543210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:08.546422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:08.548107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6fc98ffd-1ceb-48ac-987b-ebfcff6f4dac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.224502 Jun 17 12:54:08.549180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 220/409] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:08.779255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:08.780057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:08.795525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:08.798090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:08.799494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:08.801146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:09.169135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:09.182345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-347bdc1c-f7c6-42cb-9775-e73aa0f0f71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.407910 Jun 17 12:54:09.185025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 190/410] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:08 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:09.251610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-989470845", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63451fcb-248d-4063-92cc-62a9c2c4e98f"}], "security_groups": [{"name": "tempest-securitygroup--2064561450"}], "key_name": "tempest-keypair-1718725434", "user_data": "}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:09.582729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:09.583253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:09.610664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:09.611454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:09.628237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:09.635648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:10.129968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:10.148783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:10.163921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:10.165236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4f29c928-809d-4f0b-8f75-52d4345d5e1b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.602384 Jun 17 12:54:10.165823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 191/411] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:10.201162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:10.201775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:10.216789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:10.217650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:10.218750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:10.219387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:10.589134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:10.615105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-16f3050d-6b27-41d9-ab6a-ad3d945fe54c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1279 microversion: 2.1 time: 0.417626 Jun 17 12:54:10.632172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 192/412] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:10 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1279 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:11.025572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1919207703", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c808cce-5566-4c2e-aca7-558956794d91"}], "security_groups": [{"name": "tempest-securitygroup--1456870887"}], "key_name": "tempest-keypair-1986221162", "user_data": "}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:12.449608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] validate_networks() for [('8c808cce-5566-4c2e-aca7-558956794d91', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:54:12.465714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] validate_networks() for [('63451fcb-248d-4063-92cc-62a9c2c4e98f', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:54:12.977354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:54:12.980985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:54:12.981914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:54:12.982337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:54:12.982898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:54:12.995202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:12.996162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:12.997763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:12.998269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.021849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for project 8ba886227347427bb1cbce939509be05. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:54:13.027557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:54:13.028007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:54:13.028118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Getting quotas for user efee42b434cd47d99984b85f677983c2 and project 8ba886227347427bb1cbce939509be05. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:54:13.028561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:54:13.029329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:54:13.029906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:54:13.039985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.040752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.045336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:54:13.051782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:54:13.076624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.082322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.107776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:54:13.122942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:54:13.125625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-461386ad-1a58-4dcc-8fb6-c6f3f3790406 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.104248 Jun 17 12:54:13.131860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 193/413] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:54:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:54:13.137762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:13.138421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:13.141261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:54:13.144260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:54:13.146020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.146681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.147640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.148221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.226885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0d4b21b8-e19c-43e0-9f75-0f0aaa4c88a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.980285 Jun 17 12:54:13.233137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 221/414] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:54:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 3984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:54:13.249339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-97809a74-038c-4fd1-bafd-e3a9d78b586d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:13.282516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97809a74-038c-4fd1-bafd-e3a9d78b586d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.282727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97809a74-038c-4fd1-bafd-e3a9d78b586d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.374821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:13.387136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:13.390003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:13.392281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a5384a4b-f1a3-4439-abdb-330b3c1a7737 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.259312 Jun 17 12:54:13.393301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 194/415] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:13.399535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:13.400944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:13.403837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-97809a74-038c-4fd1-bafd-e3a9d78b586d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Going to try to stop instance {{(pid=134352) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 12:54:13.412653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.413609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.414654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.415260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.486059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-97809a74-038c-4fd1-bafd-e3a9d78b586d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/action" status: 202 len: 0 microversion: 2.1 time: 0.251061 Jun 17 12:54:13.490736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 222/416] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:54:13 2022] POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:54:13.524333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4da29da5-e81c-4340-8e82-71a6a8e15dcf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:13.526255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4da29da5-e81c-4340-8e82-71a6a8e15dcf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:13.626546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4da29da5-e81c-4340-8e82-71a6a8e15dcf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:13.634290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4da29da5-e81c-4340-8e82-71a6a8e15dcf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1246 microversion: 2.1 time: 0.142165 Jun 17 12:54:13.636742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 223/417] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:13.656051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2a961d10-c17e-4a30-baa7-bb543ad4507f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:13.656976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2a961d10-c17e-4a30-baa7-bb543ad4507f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:13.659993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:13.729435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a961d10-c17e-4a30-baa7-bb543ad4507f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:13.739997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2a961d10-c17e-4a30-baa7-bb543ad4507f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1241 microversion: 2.1 time: 0.090147 Jun 17 12:54:13.741516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 224/418] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:13 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:13.746623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:13.747420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:13.755576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.756819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.757985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:13.758641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:13.829120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:13.846083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-87c1dd05-4cce-46ca-a02b-4e9a4a48eebd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.451515 Jun 17 12:54:13.846993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 195/419] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:13 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:14.073462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:14.082777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11aa2ed4-5f54-4ca5-b8a5-bd321f7dc013 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.339789 Jun 17 12:54:14.085176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 225/420] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:14.410849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:14.411481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:14.425073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.425576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.426362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.426799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.595272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:14.611553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:14.613371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:14.614581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff36dc86-7437-448f-9f65-15c149d792d5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.208035 Jun 17 12:54:14.615137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 196/421] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:14.655223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:14.656518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:14.664574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.665279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.666085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.666551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.736658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:14.740132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:14.744899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-819c2d98-bad5-488a-8e18-0d164511d01a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1298 microversion: 2.1 time: 0.094228 Jun 17 12:54:14.755544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 226/422] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:14 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:14.760804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:14.762792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:14.769161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.769810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.770862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.771601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.869311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:14.870354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:14.883006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:14.885623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.886388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.888019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:14.889039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:14.899908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f9449ad9-e057-4408-8614-457103a22faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1293 microversion: 2.1 time: 0.142777 Jun 17 12:54:14.900795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 197/423] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:14 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:15.090207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:15.103361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:15.103997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:15.104245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-778cec3a-fb0d-417f-b24a-9417ca650dae tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.239377 Jun 17 12:54:15.108039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 227/424] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:14 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:15.115791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.116673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:15.117678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.118325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:15.580793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:15.595407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a6b3483a-0307-40fb-b2ea-2c6605f64b38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.496723 Jun 17 12:54:15.597937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 198/425] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:15.635806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:15.636768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:15.647105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.647872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:15.648847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.652004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:15.762254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:15.763291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:15.773717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.774866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:15.775917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.776644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:15.789231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:15.846060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:15.862701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:15.864208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:15.865390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-84e9db73-1077-4b42-8e7e-1a91fa976311 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.236630 Jun 17 12:54:15.881482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 228/426] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:15.919899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:15.921035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:15.934457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.934905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:15.947313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:15.947818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:16.036284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:16.045244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c4ce0c35-8cbc-4506-945d-1a3555c7476b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1299 microversion: 2.1 time: 0.130881 Jun 17 12:54:16.046531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 229/427] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:15 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:16.127039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:16.130920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:16.143413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:16.143866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:16.146846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:16.146846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:16.176958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:16.185283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fc2a7301-20d9-4fe7-bf6f-cf5630406d4e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1304 microversion: 2.1 time: 0.426880 Jun 17 12:54:16.196385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 199/428] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:15 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1304 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:16.319263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:16.334308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-291a4977-03b7-4425-8814-112d579b77b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.210977 Jun 17 12:54:16.343429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 230/429] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:16 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:16.615705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:16.616310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:16.624936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:16.625378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:16.626177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:16.626791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:16.893044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:16.895052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:16.905085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:16.910168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:16.916080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:16.922729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:16.928958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:16.943704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-098ee2b3-80a3-4a86-8003-091ecd9e6a03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.333025 Jun 17 12:54:16.944304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 200/430] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:17.065268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:17.068763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:17.086922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.087615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:17.088558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.090326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:17.260749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:17.275216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:17.277465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:17.278037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c8cb0d0b-d62e-436b-a64a-d29cf4e2213f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.393140 Jun 17 12:54:17.290704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 231/431] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:17.290704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:17.290704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:17.305254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.305755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:17.306567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.307008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:17.580782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:17.600664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b1d762b2-f418-49b4-886c-fd506026f247 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.319515 Jun 17 12:54:17.601617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 232/432] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:17.615057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:17.621458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:17.631197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.631713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:17.632873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.633002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:17.650883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:17.660357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df6855da-0297-4f2d-bf8b-dd8720b40872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.599736 Jun 17 12:54:17.660953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 201/433] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:17 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:17.788043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:17.796456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f306d317-24eb-400a-bcdb-6c27955f125d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.185171 Jun 17 12:54:17.807745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 233/434] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:17 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:17.962905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:17.963939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:17.970910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.971641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:17.972589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:17.973245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.282376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:18.293387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-187f25d5-3fde-41f1-876b-706bbfb1c37b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.333335 Jun 17 12:54:18.294709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 202/435] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:18.307634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:18.308893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:18.317099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.317846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.318908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.319541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.524470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:18.536111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:18.537657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:18.539027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f94fc148-b35b-4468-a255-c600ee703381 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.244857 Jun 17 12:54:18.539629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 234/436] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:18.568291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-0170e145-454c-45e9-8092-400e4d4ed411 req-0b3a201d-aebe-4f3a-bbd4-faef0c6ede2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf52b0f3-44a6-4d5c-82fb-e662f185c898", "tag": "0aab43a3-bc7b-4476-a4ce-489abc0ff452"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:18.576837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0170e145-454c-45e9-8092-400e4d4ed411 req-0b3a201d-aebe-4f3a-bbd4-faef0c6ede2c service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.577479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0170e145-454c-45e9-8092-400e4d4ed411 req-0b3a201d-aebe-4f3a-bbd4-faef0c6ede2c service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.603740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-0170e145-454c-45e9-8092-400e4d4ed411 req-0b3a201d-aebe-4f3a-bbd4-faef0c6ede2c service nova] Creating event network-changed:0aab43a3-bc7b-4476-a4ce-489abc0ff452 for instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 on hv-cinder-84617 Jun 17 12:54:18.611831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-0170e145-454c-45e9-8092-400e4d4ed411 req-0b3a201d-aebe-4f3a-bbd4-faef0c6ede2c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049621 Jun 17 12:54:18.613069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 203/437] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:18.620809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:18.621426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:18.628510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.629350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.630299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.630886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.679923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:18.682766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:18.695187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.695665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.696453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.696997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.817138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:18.824977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c2ad6fe4-2156-448e-aa9a-09c86de893e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.210972 Jun 17 12:54:18.825591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 235/438] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:18 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:18.831825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:18.832699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:18.839340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.840235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:18.841590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:18.842196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:19.041848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:19.049965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d83db552-af42-47d0-afde-6b154500fca4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.223352 Jun 17 12:54:19.050544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 236/439] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:18 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:19.069491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:19.078112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ece54583-4158-40ce-bf48-ed2285756f8a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.403611 Jun 17 12:54:19.078771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 204/440] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:18 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:19.311264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:19.312864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:19.320510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:19.321289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:19.322164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:19.322657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:19.558397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:19.559198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:19.565680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:19.567106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:19.567613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:19.571442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:19.572076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:19.580765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-852eda67-e61b-402e-8ba0-017fc3d665ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.273625 Jun 17 12:54:19.581605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 237/441] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:19.843037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:19.843672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:19.857208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:19.857918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:19.858905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:19.859609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:19.884897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:19.897269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:19.899496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:19.902742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aedf4fc8-f71f-4dd3-8485-1cd9c553d5f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.348417 Jun 17 12:54:19.905441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 205/442] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:20.015539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:20.023143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76d574a9-c42b-4344-a381-644a01d92298 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.184647 Jun 17 12:54:20.023756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 238/443] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:19 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:20.066329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:20.067033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:20.073479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.073925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.074764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.075193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.097031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:20.097910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:20.107699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.108201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.108979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.109408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.227245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:20.235784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1591e79e-57d4-446a-ac7e-6ca8cd2d60f0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.173395 Jun 17 12:54:20.236365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 206/444] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:20 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:20.268981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:20.276935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-607ffa10-2759-4652-88f5-2215f303e9e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.183730 Jun 17 12:54:20.277524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 239/445] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:20 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:20.598291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:20.598887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:20.605272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.605720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.606486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.606919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.682962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-8cc85816-0f66-4be2-adb8-426e6e5ff85a req-d9b9240d-41dc-4d6d-82fd-86937d5eaf39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20dafd2a-15d7-4ada-b421-c051e3998e05", "tag": "e123181a-e3e0-4499-9821-44daff95c0bc"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:20.692603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-8cc85816-0f66-4be2-adb8-426e6e5ff85a req-d9b9240d-41dc-4d6d-82fd-86937d5eaf39 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.693043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-8cc85816-0f66-4be2-adb8-426e6e5ff85a req-d9b9240d-41dc-4d6d-82fd-86937d5eaf39 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.706336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-8cc85816-0f66-4be2-adb8-426e6e5ff85a req-d9b9240d-41dc-4d6d-82fd-86937d5eaf39 service nova] Creating event network-changed:e123181a-e3e0-4499-9821-44daff95c0bc for instance 20dafd2a-15d7-4ada-b421-c051e3998e05 on hv-cinder-84617 Jun 17 12:54:20.712055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-8cc85816-0f66-4be2-adb8-426e6e5ff85a req-d9b9240d-41dc-4d6d-82fd-86937d5eaf39 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Jun 17 12:54:20.712909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 240/446] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:20.842629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:20.851297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b852f3ad-33e8-48a1-88da-4063e10e1564 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.256919 Jun 17 12:54:20.851893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 207/447] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:20.924139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:20.924760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:20.933266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.933703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:20.934507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:20.934927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.040286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:21.041651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:21.047974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.048768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.049937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.050583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.077142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:21.086343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:21.087834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:21.089012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-22cdbd44-708a-4b06-a912-ed35143496c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1741 microversion: 2.20 time: 0.169534 Jun 17 12:54:21.089862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 241/448] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:21.253209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:21.253813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:21.260467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.260918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.261683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.262123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.408137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:21.416353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-768dc151-564b-4c5e-ab1f-7d76ce37862b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.167167 Jun 17 12:54:21.425929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 242/449] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:21 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:21.425929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:21.425929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:21.428874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.429554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.430438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.430892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.603725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:21.606855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:21.615851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-03816d6d-b5c5-47fe-a5ec-edb4cafe0d68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.197707 Jun 17 12:54:21.616531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 243/450] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:21 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:21.617371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8c3c4adf-d08f-4d7b-9c07-27d2f87ea6bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.580987 Jun 17 12:54:21.617956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 208/451] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:21.717970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-7f5f0453-5174-4c83-bda3-3edf7867aa7c req-7450a8c5-cf30-4ce9-9cf9-13fc0e1436dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556e3927-0db8-47b5-a3f0-f0338fd92dee", "name": "network-vif-plugged", "status": "completed", "tag": "70865a20-dd41-4701-9d32-dd973d8fd09d"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:21.729247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-7f5f0453-5174-4c83-bda3-3edf7867aa7c req-7450a8c5-cf30-4ce9-9cf9-13fc0e1436dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.729687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-7f5f0453-5174-4c83-bda3-3edf7867aa7c req-7450a8c5-cf30-4ce9-9cf9-13fc0e1436dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.738863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:21.748717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-7f5f0453-5174-4c83-bda3-3edf7867aa7c req-7450a8c5-cf30-4ce9-9cf9-13fc0e1436dc service nova] Creating event network-vif-plugged:70865a20-dd41-4701-9d32-dd973d8fd09d for instance 556e3927-0db8-47b5-a3f0-f0338fd92dee on hv-cinder-84617 Jun 17 12:54:21.755104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-7f5f0453-5174-4c83-bda3-3edf7867aa7c req-7450a8c5-cf30-4ce9-9cf9-13fc0e1436dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040672 Jun 17 12:54:21.756143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 244/452] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:54:21.868905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:21.869505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:21.875992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.876749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:21.878324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:21.878753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.114699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:22.115785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:22.123618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.124857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.125777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.126582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.297851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:22.310845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:22.313256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:22.314774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81ead128-8df1-4587-8129-fe94939198fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1723 microversion: 2.20 time: 0.205411 Jun 17 12:54:22.325430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 245/453] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:22.418740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:22.428504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cd9436e6-f594-41f8-bdd6-05a105b67e58 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.562721 Jun 17 12:54:22.438434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 209/454] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:22.444439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:22.445169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:22.451348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.451900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.452746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.453329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.617412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:22.625794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe2eb08e-abf2-431a-9fff-9750f9e1e10d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.186013 Jun 17 12:54:22.626733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 246/455] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:22 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:22.641145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:22.641826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:22.648619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.649385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.650362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.650799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.651844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:22.652459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:22.660295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.660736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.661498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:22.661924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:22.808157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:22.816863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9f0d07f-d002-4b49-ad0a-2b4e553f967b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.179042 Jun 17 12:54:22.817439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 247/456] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:22 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:22.991054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:22.998858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c6b66c33-84e1-449b-98c6-483224003ade tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.361861 Jun 17 12:54:22.999712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 210/457] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:22 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:23.333641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:23.334379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:23.336544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:23.342089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.342530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.343291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.343775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.445753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:23.446378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:23.449050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:23.450084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=6 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:23.466913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.468750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.469547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.470116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.538503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:23.563501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:23.565728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:23.566921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4db181fd-fa33-4f10-a809-50f30fb80b45 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1723 microversion: 2.20 time: 0.237459 Jun 17 12:54:23.572026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 248/458] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:23.626936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:23.638918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eb517217-6a48-46b2-924a-25ef9ecf6797 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.197861 Jun 17 12:54:23.640087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 211/459] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:23.647958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:23.648860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:23.666766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.667206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.668362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.668799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.739894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=18 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:23.814683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:23.839553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4175aad2-fa37-434d-a103-4cf5d9dfe0a1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.191361 Jun 17 12:54:23.839553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 249/460] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:23 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:23.840515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:23.840515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:23.842408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.843050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.844031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:23.844621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:23.997715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:24.005844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a3d88bcf-c657-4b14-a77f-d2f10dc2c10d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.175211 Jun 17 12:54:24.006874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 212/461] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:23 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:24.018353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:24.019075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:24.027469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.027924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:24.028699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.029126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:24.177757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:24.186011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8950982e-f94d-4477-841e-435a4521a068 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.172712 Jun 17 12:54:24.186600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 250/462] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:24.590610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:24.591186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:24.593225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:24.600293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.600740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:24.601508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.601943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:24.657769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:24.658443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:24.667047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.667525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:24.668293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.668720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:24.755072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:24.764869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:24.766526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:24.767809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-20cf8fe5-d7c6-47c0-82de-5fb5f799ab50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1723 microversion: 2.20 time: 0.181124 Jun 17 12:54:24.768549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 213/463] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:24.811412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:24.821007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4f2743e3-a538-4351-bc6d-8ef212ff5e38 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.167304 Jun 17 12:54:24.821593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 251/464] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:24.849528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:24.850389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:24.856763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.857205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:24.857957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:24.858382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.024308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:25.024920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:25.031210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.031700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.032460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.032889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.105752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:25.122250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-128e2078-e6f9-4317-88bf-3a0492a97ed5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1267 microversion: 2.1 time: 0.275651 Jun 17 12:54:25.123113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 214/465] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:24 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:25.195829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:25.204311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ee820a4f-f413-4f65-a221-8d7a22942518 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.183758 Jun 17 12:54:25.205124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 252/466] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:25 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:25.208870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:25.209761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:25.216084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.216535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.217307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.217742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.354439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:25.362095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bb4e79b4-dd2a-4de3-8a24-32802ceb1896 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.157883 Jun 17 12:54:25.362882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 215/467] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:25 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:25.786862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:25.787502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:25.801101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.801553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.802341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.802772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.841145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-5e6d0c90-fd25-4e1e-ac04-f80dfd71825d req-e99e81bd-7f57-4b4d-bc33-46ce2d46062c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf52b0f3-44a6-4d5c-82fb-e662f185c898", "name": "network-vif-plugged", "status": "completed", "tag": "0aab43a3-bc7b-4476-a4ce-489abc0ff452"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:25.860541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-5e6d0c90-fd25-4e1e-ac04-f80dfd71825d req-e99e81bd-7f57-4b4d-bc33-46ce2d46062c service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.863085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-5e6d0c90-fd25-4e1e-ac04-f80dfd71825d req-e99e81bd-7f57-4b4d-bc33-46ce2d46062c service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.880580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-5e6d0c90-fd25-4e1e-ac04-f80dfd71825d req-e99e81bd-7f57-4b4d-bc33-46ce2d46062c service nova] Creating event network-vif-plugged:0aab43a3-bc7b-4476-a4ce-489abc0ff452 for instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 on hv-cinder-84617 Jun 17 12:54:25.885750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-5e6d0c90-fd25-4e1e-ac04-f80dfd71825d req-e99e81bd-7f57-4b4d-bc33-46ce2d46062c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050161 Jun 17 12:54:25.886359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 216/468] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:25.891845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:25.892547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:25.899998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.900581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.901366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:25.901802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:25.908237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:25.987874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:25.997808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:25.999309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:26.000514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2a52116d-95f7-433d-81ac-886d7ac2e108 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1723 microversion: 2.20 time: 0.217653 Jun 17 12:54:26.001089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 253/469] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:26.139646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:26.140273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:26.147175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.147760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.148638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.149133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.298569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:26.308812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-db44e49c-4a20-4f17-8f74-d69ecfdc111e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1453 microversion: 2.1 time: 0.173369 Jun 17 12:54:26.308993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:26.309745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 254/470] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:26 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:26.314878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:26.315604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:26.322910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.323194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4bb720a6-4d4f-412c-a005-c7cfeb0ed6de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.434068 Jun 17 12:54:26.323380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.324179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.324606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.327986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 217/471] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:25 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:26.336090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:26.336711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:26.354942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.355419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.356213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.356646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.480023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:26.488182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ca63d845-ce75-4ea4-8dbc-f299aca7cbb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.177459 Jun 17 12:54:26.488755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 255/472] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:26 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:26.494259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:26.496920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:26.497524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:26.502966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9d949766-9202-464b-b0ed-a375ed5f26cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1453 microversion: 2.1 time: 0.173860 Jun 17 12:54:26.503715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 218/473] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:26 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:26.504028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.504509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.505384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:26.505840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:26.651451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:26.659325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3a727a1a-46ea-416d-89ce-d4e83504abee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.169537 Jun 17 12:54:26.660183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 256/474] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:27.018555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:27.019234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:27.026296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.026816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.027698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.028238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.249503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:27.258709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:27.260238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:27.261408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-67b13287-dbb7-4bfe-9856-71037aa6493a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1723 microversion: 2.20 time: 0.246906 Jun 17 12:54:27.262146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 219/475] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:27.345127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:27.346401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:27.354256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.354710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.355525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.355958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.492822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:27.501818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f8ed91d8-5157-4f31-b404-ad7b3a2d9163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.160545 Jun 17 12:54:27.502714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 257/476] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:27.505903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:27.506518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:27.513073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.513523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.514295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.514730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.680277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:27.681008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:27.687660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.688217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.689152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.689761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.727173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:27.737365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dadfaaa1-31f1-4e00-a12d-5feb9e5a0630 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.235626 Jun 17 12:54:27.738825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 220/477] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:27 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:27.836009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:27.844554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3dbd0d22-f90e-4ac0-b6b5-da772cf26b28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.169837 Jun 17 12:54:27.845350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 258/478] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:27.927960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-392d6124-072c-4d50-8b0a-a8429d8e5d11 req-b72df44c-5253-4829-ac02-35b1b1cd9feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "name": "network-vif-unplugged", "status": "completed", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}, {"server_uuid": "20dafd2a-15d7-4ada-b421-c051e3998e05", "name": "network-vif-plugged", "status": "completed", "tag": "e123181a-e3e0-4499-9821-44daff95c0bc"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:27.938030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-392d6124-072c-4d50-8b0a-a8429d8e5d11 req-b72df44c-5253-4829-ac02-35b1b1cd9feb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:27.938501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-392d6124-072c-4d50-8b0a-a8429d8e5d11 req-b72df44c-5253-4829-ac02-35b1b1cd9feb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:27.953520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-392d6124-072c-4d50-8b0a-a8429d8e5d11 req-b72df44c-5253-4829-ac02-35b1b1cd9feb service nova] Creating event network-vif-unplugged:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 12:54:27.954026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-392d6124-072c-4d50-8b0a-a8429d8e5d11 req-b72df44c-5253-4829-ac02-35b1b1cd9feb service nova] Creating event network-vif-plugged:e123181a-e3e0-4499-9821-44daff95c0bc for instance 20dafd2a-15d7-4ada-b421-c051e3998e05 on hv-cinder-84617 Jun 17 12:54:27.961426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-392d6124-072c-4d50-8b0a-a8429d8e5d11 req-b72df44c-5253-4829-ac02-35b1b1cd9feb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037760 Jun 17 12:54:27.962544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 221/479] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:28.280049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:28.280685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:28.287162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.287648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.288424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.289039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.437047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:28.446341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:28.448431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:28.450017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0ca2a0af-b03d-4846-bbf8-099793c617f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1726 microversion: 2.20 time: 0.174026 Jun 17 12:54:28.450581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 259/480] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:28.469243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-872bd09f-f49c-4d3f-bfad-637c0173fd31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a396d33a-7d09-476a-b1ff-b4cf30f7af6a"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:28.470402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-872bd09f-f49c-4d3f-bfad-637c0173fd31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:28.477428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-872bd09f-f49c-4d3f-bfad-637c0173fd31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.477864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-872bd09f-f49c-4d3f-bfad-637c0173fd31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.478619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-872bd09f-f49c-4d3f-bfad-637c0173fd31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.479035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-872bd09f-f49c-4d3f-bfad-637c0173fd31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.527887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:28.528546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:28.538331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.542344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.542344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.542344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.694255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:28.702896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-60d9e936-316d-4500-a700-386f4dfd3ca9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.178850 Jun 17 12:54:28.703639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 260/481] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:28.757868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:28.759672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:28.773185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.783789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.785096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.785634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.805731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:28.866073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-872bd09f-f49c-4d3f-bfad-637c0173fd31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.401559 Jun 17 12:54:28.866645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 222/482] 10.222.0.87 () {62 vars in 1363 bytes} [Fri Jun 17 12:54:28 2022] POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 188 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:54:28.871243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-34fcf397-8a9c-474a-adc3-b5b6383b9d58 req-5c33cf67-6a0d-4426-9537-bfbaf8890794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556e3927-0db8-47b5-a3f0-f0338fd92dee", "tag": "70865a20-dd41-4701-9d32-dd973d8fd09d"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:28.899855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-34fcf397-8a9c-474a-adc3-b5b6383b9d58 req-5c33cf67-6a0d-4426-9537-bfbaf8890794 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.900473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-34fcf397-8a9c-474a-adc3-b5b6383b9d58 req-5c33cf67-6a0d-4426-9537-bfbaf8890794 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.913228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-34fcf397-8a9c-474a-adc3-b5b6383b9d58 req-5c33cf67-6a0d-4426-9537-bfbaf8890794 service nova] Creating event network-changed:70865a20-dd41-4701-9d32-dd973d8fd09d for instance 556e3927-0db8-47b5-a3f0-f0338fd92dee on hv-cinder-84617 Jun 17 12:54:28.918421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-34fcf397-8a9c-474a-adc3-b5b6383b9d58 req-5c33cf67-6a0d-4426-9537-bfbaf8890794 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050505 Jun 17 12:54:28.919616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 223/483] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:28.924872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:28.926115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:28.933672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.943065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:28.947690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:28.948588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:29.077757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:29.095581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-501c4534-2dd9-4e33-9c4e-37c6f3c1b8e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.340032 Jun 17 12:54:29.096716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 261/484] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:28 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:29.123318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3c1ab95c-84eb-4de9-b7fb-bf8bc6c4c9dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:29.124149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3c1ab95c-84eb-4de9-b7fb-bf8bc6c4c9dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:29.130686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c1ab95c-84eb-4de9-b7fb-bf8bc6c4c9dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:29.131349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c1ab95c-84eb-4de9-b7fb-bf8bc6c4c9dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:29.132345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c1ab95c-84eb-4de9-b7fb-bf8bc6c4c9dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:29.132923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c1ab95c-84eb-4de9-b7fb-bf8bc6c4c9dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:29.252066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3c1ab95c-84eb-4de9-b7fb-bf8bc6c4c9dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/action" status: 202 len: 0 microversion: 2.20 time: 0.140724 Jun 17 12:54:29.252682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 262/485] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Jun 17 12:54:29 2022] POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:54:29.264780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:29.266243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:29.273761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:29.274376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:29.275126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:29.275733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:29.277613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:29.289509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6476be4d-d682-4076-9721-2d961daf26ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.368479 Jun 17 12:54:29.290523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 224/486] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:29.446387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:29.455164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:29.456969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:29.458508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e00fa38c-363b-4cf5-bff4-32b9bd65172a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1752 microversion: 2.20 time: 0.199455 Jun 17 12:54:29.459944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 263/487] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:29.721158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:29.721759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:29.729804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:29.730532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:29.731486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:29.732058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:30.105469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:30.116024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:30.116982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:30.121431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aa186c05-5bc7-417b-98b6-9d89e77f94ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.403957 Jun 17 12:54:30.122543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 225/488] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:30.137290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:30.141216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:30.142023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:30.142448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:30.308716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:30.310097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:30.318276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:30.319196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:30.320420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:30.321161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:30.364635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:30.381739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f713a8a5-9921-4f59-b30b-a00989305f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.270204 Jun 17 12:54:30.382544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 264/489] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:30 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:30.478256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:30.478868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:30.489626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:30.490076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:30.491065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:30.491927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:30.497477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:30.506055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-418f1ecb-4936-43ed-b2a5-ddbe17a6be9d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1372 microversion: 2.1 time: 0.201897 Jun 17 12:54:30.506652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 226/490] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:30 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:30.637009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:30.646626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:30.648183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:30.649345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9851f2cc-6c01-488b-a9a7-d350ab18f667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1752 microversion: 2.20 time: 0.175884 Jun 17 12:54:30.649897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 265/491] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:31.141016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:31.141602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:31.149403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.149851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.150625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.151061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.286588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:31.296008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c2488303-3ecd-4cd4-9a7f-1539d2ba56d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.159039 Jun 17 12:54:31.296602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 227/492] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:31.398872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:31.401275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:31.408513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.409026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.409883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.410377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.524361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:31.525030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:31.540650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.541106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.541901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.542331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.617426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:31.629518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-91be0545-4e20-4707-8246-a6ad9c800648 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1367 microversion: 2.1 time: 0.235123 Jun 17 12:54:31.636133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 266/493] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:31 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:31.668038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:31.668806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:31.675495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.676151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.677043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.677479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.829214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:31.838258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:31.839943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:31.841168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5314ecbf-500d-43a2-bfe4-d19421a27356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1754 microversion: 2.20 time: 0.177282 Jun 17 12:54:31.841733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 267/494] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:31.860283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:31.868035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c2422a03-dbc7-4166-8b29-ea218c38014e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1565 microversion: 2.1 time: 0.349019 Jun 17 12:54:31.868664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 228/495] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1565 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:31.884571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8007fce3-51c3-4e9f-bf80-e2bb3f8ffa67 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:31.885060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8007fce3-51c3-4e9f-bf80-e2bb3f8ffa67 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:31.891176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8007fce3-51c3-4e9f-bf80-e2bb3f8ffa67 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.891676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8007fce3-51c3-4e9f-bf80-e2bb3f8ffa67 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.892432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8007fce3-51c3-4e9f-bf80-e2bb3f8ffa67 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:31.892867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8007fce3-51c3-4e9f-bf80-e2bb3f8ffa67 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:31.977076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8007fce3-51c3-4e9f-bf80-e2bb3f8ffa67 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096559 Jun 17 12:54:31.978071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 268/496] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 12:54:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:32.314253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:32.314924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:32.325528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.325956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:32.327680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.328119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:32.628830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:32.647873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:32.649065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:32.650024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-da228196-e4a4-4037-8f92-e6e221d7706a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.339489 Jun 17 12:54:32.660009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 229/497] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:32.680287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.681230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:32.682240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.682770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:32.833011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:32.842579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cc91d1f4-cd43-474d-8032-b32e8b637f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1556 microversion: 2.1 time: 0.200330 Jun 17 12:54:32.843160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 269/498] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:32 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:32.859530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9b009c19-3a18-440c-8225-a61d1fea8cf7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:32.860434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9b009c19-3a18-440c-8225-a61d1fea8cf7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:32.868282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:32.868674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b009c19-3a18-440c-8225-a61d1fea8cf7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.869285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:32.869406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b009c19-3a18-440c-8225-a61d1fea8cf7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:32.872260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b009c19-3a18-440c-8225-a61d1fea8cf7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.872963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b009c19-3a18-440c-8225-a61d1fea8cf7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:32.876992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.877689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:32.878550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:32.879051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:33.041885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:33.051093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:33.052803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:33.053999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d00bae9e-bfe8-414f-9c7a-cfac8f580287 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1754 microversion: 2.20 time: 0.189754 Jun 17 12:54:33.054555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 270/499] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:33.122261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9b009c19-3a18-440c-8225-a61d1fea8cf7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.266642 Jun 17 12:54:33.123077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 230/500] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 12:54:32 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:33.668674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:33.669241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:33.676602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:33.677541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:33.678542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:33.679157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:33.825029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-b3179a7b-ad92-42b0-82d4-80bb78df1776 req-5cbba3ef-9e4a-4e72-9aba-cb2c3506035d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf52b0f3-44a6-4d5c-82fb-e662f185c898", "tag": "0aab43a3-bc7b-4476-a4ce-489abc0ff452"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:33.840049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b3179a7b-ad92-42b0-82d4-80bb78df1776 req-5cbba3ef-9e4a-4e72-9aba-cb2c3506035d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:33.840648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b3179a7b-ad92-42b0-82d4-80bb78df1776 req-5cbba3ef-9e4a-4e72-9aba-cb2c3506035d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:33.853023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-b3179a7b-ad92-42b0-82d4-80bb78df1776 req-5cbba3ef-9e4a-4e72-9aba-cb2c3506035d service nova] Creating event network-changed:0aab43a3-bc7b-4476-a4ce-489abc0ff452 for instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 on hv-cinder-84617 Jun 17 12:54:33.858588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-b3179a7b-ad92-42b0-82d4-80bb78df1776 req-5cbba3ef-9e4a-4e72-9aba-cb2c3506035d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038332 Jun 17 12:54:33.859706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 231/501] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:54:34.080272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:34.081373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:34.101790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:34.102235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:34.106300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:34.106757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:34.236406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:34.244717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e043e1b2-cfaf-46a6-b2b1-db8c2c468445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.580149 Jun 17 12:54:34.245297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 271/502] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:34.402728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:34.415820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:34.417537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:34.418977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7c4dd355-30af-40eb-88fb-598b555d1793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1754 microversion: 2.20 time: 0.345259 Jun 17 12:54:34.420180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 232/503] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1754 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:34.773069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-1c036d10-510c-4120-b83e-978330878d68 req-3fc88f92-ee39-450f-a165-e03dc25579cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20dafd2a-15d7-4ada-b421-c051e3998e05", "tag": "e123181a-e3e0-4499-9821-44daff95c0bc"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:34.799463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:34.801425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-1c036d10-510c-4120-b83e-978330878d68 req-3fc88f92-ee39-450f-a165-e03dc25579cb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:34.808803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-1c036d10-510c-4120-b83e-978330878d68 req-3fc88f92-ee39-450f-a165-e03dc25579cb service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:34.838040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-1c036d10-510c-4120-b83e-978330878d68 req-3fc88f92-ee39-450f-a165-e03dc25579cb service nova] Creating event network-changed:e123181a-e3e0-4499-9821-44daff95c0bc for instance 20dafd2a-15d7-4ada-b421-c051e3998e05 on hv-cinder-84617 Jun 17 12:54:34.851256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-1c036d10-510c-4120-b83e-978330878d68 req-3fc88f92-ee39-450f-a165-e03dc25579cb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081921 Jun 17 12:54:34.854637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 272/504] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:35.268501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:35.271608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:35.291824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:35.292158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:35.293066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:35.293895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:35.313261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:35.438492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:35.439602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:35.446808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:35.447594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:35.448507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:35.449236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:35.652587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:35.665199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:35.667639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:35.669210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-abb935c5-b7c0-40fa-860d-90b8cbd8e057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.234715 Jun 17 12:54:35.670027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 273/505] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:35.724736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:35.736458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc08c949-f955-4575-8c8d-076751baa91e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.476865 Jun 17 12:54:35.737528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 233/506] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:36.695701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:36.696745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:36.704916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:36.705357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:36.706339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:36.706768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:36.754564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:36.755254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:36.766261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:36.766948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:36.767747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:36.768425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:36.862393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:36.872413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:36.873906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:36.875088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-932dbaac-7d8d-454a-af53-6353de317b2e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.187834 Jun 17 12:54:36.883990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 274/507] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:36.934981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:36.949658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-db8243f2-69f7-4c96-9e50-043deb046a2f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.199120 Jun 17 12:54:36.950493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 234/508] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:37.903306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:37.903959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:37.911713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:37.912219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:37.913138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:37.913817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:37.968035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:37.968771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:37.982041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:37.984273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:37.985232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:37.985658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:38.123735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:38.139950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:38.141751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:38.143039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e63c5121-32ea-4333-adf9-44f6616110fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.243800 Jun 17 12:54:38.144473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 275/509] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:38.323046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:38.336661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-19538a66-460e-4e2a-9d85-409d8211b4be tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.373044 Jun 17 12:54:38.338255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 235/510] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:39.162925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:39.164566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:39.173080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:39.173870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:39.174680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:39.175134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:39.317484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:39.326220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:39.327727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:39.328879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7bb14a25-9968-492d-9b89-cf308623075c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.170647 Jun 17 12:54:39.329447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 276/511] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:39.355707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:39.356338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:39.363105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:39.363702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:39.364594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:39.365101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:39.512495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:39.521112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-708fdf29-8254-4520-b114-293bd25af8c0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.169342 Jun 17 12:54:39.526593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 236/512] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:40.250942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-509103481", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "networks": [{"uuid": "c4173794-86f6-4cbd-99d1-f706c968915d"}]}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:40.313440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] validate_networks() for [('c4173794-86f6-4cbd-99d1-f706c968915d', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:54:40.346617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:40.347299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:40.361830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:40.362532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:40.363051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:40.363513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:40.547638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:40.558103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:40.560093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:40.561679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-98d0fa89-85a1-4e0c-a39c-5c5282321759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.219165 Jun 17 12:54:40.573527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 237/513] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:40.578396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:40.579206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:40.604838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:40.605284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:40.606057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:40.606668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:40.748959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:54:40.749610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:54:40.750275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:54:40.750956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:54:40.751602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:54:40.762556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:40.763700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:40.765109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:40.765892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:40.778112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:40.786670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-388618d3-20b4-4db0-bffd-b77551324c4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.211995 Jun 17 12:54:40.787426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 238/514] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:40.788306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Getting quotas for project 91f9f62d475d4663ae7c211c8adb78e8. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:54:40.792473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Getting quotas for user 31af58bc06a14e3ba8b709b7deb75341 and project 91f9f62d475d4663ae7c211c8adb78e8. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:54:40.803603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:54:40.805932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:54:40.852770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bf696fde-1890-4b23-85dd-2f912f1d938c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605774 Jun 17 12:54:40.853337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 277/515] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 12:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:54:40.863148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b79720b7-6570-4a84-9024-6c73d9b8be53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:40.863781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b79720b7-6570-4a84-9024-6c73d9b8be53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:40.929303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b79720b7-6570-4a84-9024-6c73d9b8be53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:40.936164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b79720b7-6570-4a84-9024-6c73d9b8be53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1218 microversion: 2.1 time: 0.076809 Jun 17 12:54:40.937824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 239/516] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:40 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:41.581119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:41.582581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:41.589872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:41.590421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:41.591227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:41.591929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:41.733046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:41.736690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:41.743689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:41.745163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:41.746306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bafc87d0-3388-42ea-875c-507678053b92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.169971 Jun 17 12:54:41.746867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 278/517] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:41.806537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:41.807216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:41.817342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:41.817992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:41.818969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:41.819418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:41.954251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:41.955098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:41.956432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:41.965899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:41.966147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-598b8038-810c-48cf-8dff-6f1eb363d43b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.164876 Jun 17 12:54:41.967412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 240/518] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:41.974666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:41.976110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:41.976538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:42.044841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:42.053215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b57de689-d07f-4755-8574-a133b7fe4649 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1222 microversion: 2.1 time: 0.103455 Jun 17 12:54:42.054378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 279/519] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:41 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:42.769150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:42.769758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:42.776370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:42.776813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:42.777581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:42.778213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:42.928745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:42.938823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:42.940502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:42.941880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-88031696-6f40-420a-acc5-6080fb95e1e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.181571 Jun 17 12:54:42.942983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 241/520] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:42.984393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:42.985002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:42.992012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:42.992464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:42.993338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:42.993779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:43.070634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:43.071935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:43.092812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:43.093255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:43.094022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:43.094448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:43.150203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:43.161997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a6f19ac1-69ed-4fec-a85b-d81d29c36c34 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.181460 Jun 17 12:54:43.163340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 280/521] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:43.183530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:43.191306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8fab2a7d-09a2-4077-9794-8ea9e2a2bb61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1222 microversion: 2.1 time: 0.124933 Jun 17 12:54:43.192074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 242/522] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:43 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:43.962989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:43.963619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:43.970508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:43.971065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:43.971975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:43.972481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:44.133433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:44.146425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:44.148065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:44.149778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-13cc59af-d28a-4193-bb82-805cd60d309f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.191342 Jun 17 12:54:44.151785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 281/523] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:44.183095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:44.183732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:44.209558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:44.209997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:44.211487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:44.212574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:44.216764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:44.217392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:44.223680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:44.224172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:44.225008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:44.225440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:44.302057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:44.311923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d035e358-e1b4-456a-85b6-911bdfd23be3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1222 microversion: 2.1 time: 0.106322 Jun 17 12:54:44.312596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 282/524] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:44 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:44.381909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:44.390117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5c4e7d67-8b20-4dfd-8692-043e08437b8e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.211842 Jun 17 12:54:44.390689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 243/525] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:45.168895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:45.169585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:45.176419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:45.176863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:45.178498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:45.178498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:45.329591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:45.330369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:45.332916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:45.342902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:45.343645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:45.344193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:45.344410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:45.345106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:45.345538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:45.345655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f3bddc68-9434-4f57-b7f9-902c61a154dd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.180741 Jun 17 12:54:45.346137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 283/526] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:45.408332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:45.408947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:45.415648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:45.416097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:45.416874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:45.417304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:45.428783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:45.439244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70e46bc6-34e0-4160-ba9b-2c251ee5c089 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1222 microversion: 2.1 time: 0.114020 Jun 17 12:54:45.440602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 244/527] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:45 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:45.557955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:45.566972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e99d5b7-81ec-44e3-b4fd-38324bf4edbd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.162498 Jun 17 12:54:45.567541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 284/528] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:46.365657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:46.366492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:46.375606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:46.376060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:46.376876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:46.377510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:46.458209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:46.458687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:46.465336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:46.465777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:46.466543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:46.466972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:46.517151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:46.526364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:46.527950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:46.529116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1ecca380-b3e3-44ec-9b40-b1da2f0fad3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.168283 Jun 17 12:54:46.529680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 245/529] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:46.542211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:46.550760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-14cad735-12b6-4686-9bf4-2311cdb221e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1222 microversion: 2.1 time: 0.096436 Jun 17 12:54:46.551339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 285/530] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:46 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:46.584995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:46.585599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:46.592345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:46.594058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:46.594843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:46.595277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:46.731516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:46.740016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ae1955f2-1bd9-4ace-8c22-bbcba9f7c706 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.158865 Jun 17 12:54:46.740784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 246/531] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:47.556845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:47.557439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:47.564795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:47.565345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:47.566064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:47.566727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:47.569316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:47.569952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:47.576998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:47.577460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:47.578243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:47.578668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:47.709396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:47.720082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:47.721563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:47.722734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-34343635-006f-4885-a0af-cca31b3bdd59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.170851 Jun 17 12:54:47.723263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 286/532] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:47.758335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:47.759758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:47.766458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:47.766898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:47.767698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:47.768124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:47.877724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:47.885969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9248b0e1-1614-4fdd-9368-5c8f4580d839 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1222 microversion: 2.1 time: 0.320556 Jun 17 12:54:47.886582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 247/533] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:47 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1222 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:47.907794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:47.916404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8c987402-8489-47e6-a3a2-fb30e2c2e8df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1723 microversion: 2.1 time: 0.161988 Jun 17 12:54:47.916952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 287/534] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:48.745877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:48.746468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:48.753610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:48.754080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:48.754822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:48.755256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:48.906255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:48.907589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:48.908519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:48.923020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:48.924071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:48.925984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:48.927068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:48.929877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:48.933556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:48.935563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6b8ec198-358f-446a-8f0f-82467f63969e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.195700 Jun 17 12:54:48.936215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 248/535] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:48.944230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:48.945317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:48.955882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:48.956390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:48.957215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:48.957681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:48.995108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:49.003135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f18e5cbd-9ac0-40bc-b2c4-bd645283f306 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1214 microversion: 2.1 time: 0.103405 Jun 17 12:54:49.003757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 288/536] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:48 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:49.094101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:49.104532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-67d492e7-8cb7-4e7c-a22a-9964c53e8a23 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1700 microversion: 2.1 time: 0.166969 Jun 17 12:54:49.105098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 249/537] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:49.123056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2b198406-7362-4783-b8f3-c657607ba841 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:49.134425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2b198406-7362-4783-b8f3-c657607ba841 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:49.136088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2b198406-7362-4783-b8f3-c657607ba841 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:49.161541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2b198406-7362-4783-b8f3-c657607ba841 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Going to try to start instance {{(pid=134352) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 12:54:49.230898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2b198406-7362-4783-b8f3-c657607ba841 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/action" status: 202 len: 0 microversion: 2.1 time: 0.113329 Jun 17 12:54:49.231536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 289/538] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:54:49 2022] POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:54:49.242120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:49.243044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:49.252033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:49.252474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:49.253259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:49.253692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:49.397540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:49.410919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0ec993fd-edc4-4bcd-8869-3060a0c33e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1709 microversion: 2.1 time: 0.174124 Jun 17 12:54:49.411831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 250/539] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1709 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:49.963742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:49.964607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:49.971162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:49.971899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:49.972775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:49.973515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:50.024807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:50.025799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:50.032675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:50.033213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:50.034082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:50.034657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:50.040267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:50.127009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:50.133086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:50.137706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:50.139717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:50.141210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3f6b87f3-5238-4e4c-bab1-ec54cacfe4aa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.182587 Jun 17 12:54:50.142748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 290/540] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:50.145078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7f015332-0862-47db-874b-31f40742f588 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1278 microversion: 2.1 time: 0.127578 Jun 17 12:54:50.155180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 251/541] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:50 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:54:50.429691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:50.430492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:50.437973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:50.438414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:50.439167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:50.439617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:50.583126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:50.592431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-456adacf-8be3-472b-9d94-337b8fbf4bd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1709 microversion: 2.1 time: 0.166888 Jun 17 12:54:50.593153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 291/542] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:50 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:51.160249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:51.160833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:51.162221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:51.162778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:51.162934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:51.165015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:51.165741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=6 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:51.169649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:51.170142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:51.170858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:51.171346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:51.171976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:51.172419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:51.173196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:51.173609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:51.309225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:51.317068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9928cc51-35ab-4b4e-bf8f-75fecd425e2a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.158800 Jun 17 12:54:51.317581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 292/543] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:51 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:51.360314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:51.369283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:51.370870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:51.372136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cab6da00-8e8e-4f54-b851-5a25b48de3df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.215858 Jun 17 12:54:51.372870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 252/544] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:51.610904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:51.611612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:51.621811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:51.623243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:51.624581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:51.625179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:51.817068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:51.826841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-70483aa4-04ad-429b-8129-2ea20c30d9bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1709 microversion: 2.1 time: 0.219764 Jun 17 12:54:51.827580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 293/545] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1709 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:51.935943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-3677fe70-5cbe-401d-b768-453746044a20 req-9c857148-5aa6-4475-ac99-81854267c150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067c508e-8040-41dd-bc09-07434f2ed0af", "tag": "41f3efe8-155a-46f5-a608-19b404642164"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:54:51.951796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-3677fe70-5cbe-401d-b768-453746044a20 req-9c857148-5aa6-4475-ac99-81854267c150 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:51.953771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-3677fe70-5cbe-401d-b768-453746044a20 req-9c857148-5aa6-4475-ac99-81854267c150 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:51.987829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-3677fe70-5cbe-401d-b768-453746044a20 req-9c857148-5aa6-4475-ac99-81854267c150 service nova] Creating event network-changed:41f3efe8-155a-46f5-a608-19b404642164 for instance 067c508e-8040-41dd-bc09-07434f2ed0af on hv-cinder-84617 Jun 17 12:54:51.996140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-3677fe70-5cbe-401d-b768-453746044a20 req-9c857148-5aa6-4475-ac99-81854267c150 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064147 Jun 17 12:54:51.997851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 253/546] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:52.338418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:52.339552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:52.352898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:52.353720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:52.355355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:52.355819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:52.377405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:52.391722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:52.393329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:52.400914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:52.401665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:52.402452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:52.402892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:52.505126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:52.512998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6cfe6afa-e955-4d04-b6f6-661f22650976 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.181207 Jun 17 12:54:52.513560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 294/547] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:52 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:52.635084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:52.645914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:52.647442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:52.648614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f78d81b8-e870-4484-ad4c-4d1c6d70cc91 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.261815 Jun 17 12:54:52.649181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 254/548] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:52.845517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:52.846119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:52.853063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:52.853485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:52.854253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:52.854818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:52.994330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:53.010131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9e0168b3-7f7a-4d7b-8d17-7c59f8432625 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1713 microversion: 2.1 time: 0.168682 Jun 17 12:54:53.010874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 295/549] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1713 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:53.529984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:53.530731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:53.538147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:53.538620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:53.539428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:53.539911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:53.667102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:53.668305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:53.674983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:53.675415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:53.676239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:53.676659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:53.688979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:53.697220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3be366e5-a7b6-4bfc-8b9a-0c51da66f6de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.171484 Jun 17 12:54:53.697758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 255/550] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:53 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:53.816297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:53.825313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:53.826782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:53.827957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a4605f81-e64e-46a8-b233-a8d6274d4401 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.165130 Jun 17 12:54:53.828522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 296/551] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:54:54.714903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:54.715602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:54.718295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=88 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:54.724698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:54.725173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:54.726348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:54.727286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:54.853443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:54.854073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:54.861080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:54.861520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:54.862290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:54.862719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:54.884219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:54.892481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1e0c4857-c6c7-4707-8344-266f7cf2047c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.181598 Jun 17 12:54:54.893084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 256/552] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:54 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:55.003525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:55.022634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:55.025352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:55.027295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bab23782-c5c4-43ec-83d6-d1754b35baf1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.178496 Jun 17 12:54:55.027882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 297/553] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:55.915071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:55.916137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:55.923757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:55.924206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:55.924973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:55.925406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:56.046331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:56.046923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:56.053843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:56.054376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:56.055147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:56.055608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:56.062457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:56.070233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6c838b58-5d8c-4f1e-a645-cb88406c8193 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.161641 Jun 17 12:54:56.070909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 257/554] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:55 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:56.194569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:56.207953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:56.209971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:56.211879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ba386fa8-a705-4484-8ec2-674121628d49 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.169314 Jun 17 12:54:56.212683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 298/555] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:57.091417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:57.092113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:57.099848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:57.100348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:57.101195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:57.102032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:57.230759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:57.231409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:57.233716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:57.238423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:57.238798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:57.239579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:57.240016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:57.241523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-13580454-53c9-4814-b4ff-59366da8a5be tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.156536 Jun 17 12:54:57.242108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 258/556] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:57 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:57.380857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:57.389672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:57.391164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:57.392334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0375865b-6fac-45ad-afc8-cc03a853e9a7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.165942 Jun 17 12:54:57.392931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 299/557] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:58.260214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:58.260921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:58.267971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:58.268415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:58.269174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:58.269601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:58.411907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:58.412584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:58.415930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:58.419408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:58.420143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:58.421121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:58.421551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:58.423955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a14aa5b-6473-43f0-afe8-afd4c5ef95c4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.169076 Jun 17 12:54:58.424530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 259/558] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:58 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:58.555437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:58.564168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:58.565644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:58.566797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-646a432e-ff1a-41c6-b39c-26264f507a3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.159928 Jun 17 12:54:58.567352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 300/559] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:54:59.441585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:59.442229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:59.449297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:59.449747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:59.450486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:59.450914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:59.583090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:59.585082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:59.585683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:54:59.591103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-759a4662-c3af-4468-980e-99efa111f5ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.153648 Jun 17 12:54:59.591685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 260/560] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:54:59 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:59.592353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:59.592798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:59.593558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:59.593990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:59.744109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:59.757995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:59.760078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:54:59.761903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bc7aee3d-929b-49ae-8501-ed89f74a4601 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.180423 Jun 17 12:54:59.762811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 301/561] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:54:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:00.157224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-0ab12c54-7487-4150-8b72-b1f8912e97ca req-6fadd743-43db-433a-88e8-8d07c96dae0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067c508e-8040-41dd-bc09-07434f2ed0af", "name": "network-vif-plugged", "status": "completed", "tag": "41f3efe8-155a-46f5-a608-19b404642164"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:55:00.166897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0ab12c54-7487-4150-8b72-b1f8912e97ca req-6fadd743-43db-433a-88e8-8d07c96dae0a service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:00.167443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0ab12c54-7487-4150-8b72-b1f8912e97ca req-6fadd743-43db-433a-88e8-8d07c96dae0a service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:00.178771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-0ab12c54-7487-4150-8b72-b1f8912e97ca req-6fadd743-43db-433a-88e8-8d07c96dae0a service nova] Creating event network-vif-plugged:41f3efe8-155a-46f5-a608-19b404642164 for instance 067c508e-8040-41dd-bc09-07434f2ed0af on hv-cinder-84617 Jun 17 12:55:00.183904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-0ab12c54-7487-4150-8b72-b1f8912e97ca req-6fadd743-43db-433a-88e8-8d07c96dae0a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030661 Jun 17 12:55:00.184595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 261/562] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:55:00.613417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:00.614637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:00.625457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:00.625901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:00.626667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:00.627096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:00.762917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:00.771140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-32df5f4e-4c78-45b7-9591-09c28028d79f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.164407 Jun 17 12:55:00.772053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 302/563] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:00 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:00.782747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:00.783480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:00.790021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:00.790498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:00.791265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:00.791784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:00.926649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:00.935918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:00.938037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:00.938962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3d6eecdc-0e66-4850-bda9-3f5fc8456625 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.161060 Jun 17 12:55:00.939705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 262/564] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:01.793552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:01.794409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:01.803120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:01.803585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:01.804340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:01.804773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:01.949099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:01.957414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:01.957948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0b5be8f1-7998-404f-9e55-ec8ffd6bb8e9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.170530 Jun 17 12:55:01.958055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:01.959545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 303/565] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:01 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:01.964696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:01.965174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:01.965941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:01.966387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:02.106315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:02.116905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:02.118724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:02.119957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a343151d-2491-460c-9f61-930e43f0282f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.166596 Jun 17 12:55:02.120501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 263/566] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:02.200537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-c94591d1-e64f-4f52-a81a-41dbe150e225 req-77fff863-e4e3-49af-b44d-af7c7e281a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "name": "network-vif-plugged", "status": "completed", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:55:02.209300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-c94591d1-e64f-4f52-a81a-41dbe150e225 req-77fff863-e4e3-49af-b44d-af7c7e281a63 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:02.209815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-c94591d1-e64f-4f52-a81a-41dbe150e225 req-77fff863-e4e3-49af-b44d-af7c7e281a63 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:02.221785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-c94591d1-e64f-4f52-a81a-41dbe150e225 req-77fff863-e4e3-49af-b44d-af7c7e281a63 service nova] Creating event network-vif-plugged:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 12:55:02.227563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-c94591d1-e64f-4f52-a81a-41dbe150e225 req-77fff863-e4e3-49af-b44d-af7c7e281a63 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032183 Jun 17 12:55:02.228164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 304/567] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:55:02.974768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:02.975494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:02.982809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:02.983248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:02.984040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:02.984461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:03.122596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:03.130594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a23dec05-d1c9-42d9-a0f5-b91a4aafbf39 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1318 microversion: 2.1 time: 0.160155 Jun 17 12:55:03.131158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 264/568] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:02 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:03.139145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:03.139863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:03.146600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:03.147040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:03.147825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:03.148255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:03.289770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:03.298407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:03.300063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:03.301138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3a17e698-751c-48da-8566-43089af0534e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.166833 Jun 17 12:55:03.301860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 305/569] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:04.148018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:04.149949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:04.156607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:04.157050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:04.157894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:04.158247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:04.303729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:04.312354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3bc6baad-15aa-401e-b350-3d263ef19bb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1507 microversion: 2.1 time: 0.168626 Jun 17 12:55:04.313100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 265/570] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:04 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:04.326586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:04.327251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:04.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:04.334558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:04.335997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:04.336979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:04.536659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:04.545689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:04.547223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:04.548306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0cf999c6-ca5d-434c-9cd7-02d0d3295e05 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.227682 Jun 17 12:55:04.549124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 306/571] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:05.566898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:05.567575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:05.574886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:05.575343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:05.576132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:05.576562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:05.720591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:05.730205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:05.731719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:05.732900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-27da7778-60d7-4f9d-b52f-82d8ea53f711 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.170280 Jun 17 12:55:05.733470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 266/572] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:06.760083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:06.761029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:06.763735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:06.771033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:06.771916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:06.773070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:06.773588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:06.921084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:06.930024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:06.931651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:06.932857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-728feec2-fb6c-4375-b69f-a7be23feb1ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.180389 Jun 17 12:55:06.933422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 307/573] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:07.957895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:07.958500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:07.965155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:07.965640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:07.966402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:07.966827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:08.115108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:08.124937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:08.126665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:08.127836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a2299c7c-9440-41b7-965b-68597011d9f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.174069 Jun 17 12:55:08.128650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 267/574] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:09.146965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:09.147616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:09.154689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:09.155129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:09.155929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:09.156358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:09.307545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:09.320455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:09.322776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:09.324585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-db61cf05-00ef-4622-aabe-59a399ea8ae8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.181644 Jun 17 12:55:09.325369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 308/575] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:10.346144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:10.346749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:10.354279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:10.354737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:10.355589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:10.356039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:10.497767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:10.507698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:10.509189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:10.510339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-482ed6a6-9b93-4cc2-969b-3c7741b06f72 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.168806 Jun 17 12:55:10.510888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 268/576] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:11.529083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:11.529673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:11.536591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:11.537036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:11.538131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:11.538279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:11.684142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:11.692965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:11.694432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:11.695603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4167cb0-4783-4da6-94bb-6270766384a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.170465 Jun 17 12:55:11.696127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 309/577] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:12.718573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:12.719652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:12.728479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:12.728919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:12.729679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:12.730114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:12.734203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:12.878770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:12.888114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:12.889607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:12.890746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d928d0ba-5079-4a1f-bd99-724089cfd912 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.178738 Jun 17 12:55:12.891305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 269/578] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:13.908648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:13.909218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:13.916646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:13.917084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:13.917844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:13.918275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:14.069494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:14.078339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:14.079864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:14.081020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-804bc6cc-e06f-4d27-b556-389f23907d9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.176481 Jun 17 12:55:14.081566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 310/579] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:15.099923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:15.100594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:15.108041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:15.108486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:15.109237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:15.109666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:15.248873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:15.262239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:15.264860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:15.267083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-409289ed-36e8-45ad-8d27-ea6f4b04322a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.170922 Jun 17 12:55:15.268332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 270/580] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:16.291472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:16.292101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:16.299409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:16.299889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:16.300661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:16.301090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:16.435427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:16.439159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:16.445848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:16.447903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:16.449077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dee1af1f-f006-4424-bed0-b23ddd084524 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.163307 Jun 17 12:55:16.449902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 311/581] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:17.467790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:17.468414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:17.475507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:17.476040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:17.476899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:17.477336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:17.614131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:17.622925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:17.624484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:17.625628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1b65c62a-7e0b-43f1-bc78-493cd2d28f5b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.161756 Jun 17 12:55:17.626151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 271/582] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:18.651068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:18.651758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:18.658788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:18.659232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:18.660032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:18.660539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:18.802590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:18.814847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:18.817008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:18.818684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2054c331-e458-43f2-bffd-6d3a44b64a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.173579 Jun 17 12:55:18.819398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 312/583] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:19.838971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:19.839742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:19.847831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:19.848363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:19.849249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:19.849756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:19.988855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:19.997713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:19.999209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:20.000485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e9f779aa-5a49-4371-8cae-74d12a6dd699 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.166373 Jun 17 12:55:20.001037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 272/584] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:21.019225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:21.019811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:21.026509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:21.026955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:21.027744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:21.028177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:21.176146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:21.188967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:21.191466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:21.193334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-62477e7a-707d-4852-8c37-3ef0cecc6f64 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.177730 Jun 17 12:55:21.194195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 313/585] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:22.214336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:22.214918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:22.222181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:22.222628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:22.223470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:22.223911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:22.369334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:22.378650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:22.380147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:22.381289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1ab48146-a4f6-4510-96be-be49530e63b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.170999 Jun 17 12:55:22.381874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 273/586] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:23.400486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:23.401066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:23.407862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:23.408447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:23.409167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:23.409605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:23.554235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:23.563032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:23.564618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:23.565766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f82ae10f-0b30-4bda-8594-c080c2c54a6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.169331 Jun 17 12:55:23.566360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 314/587] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:24.585726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:24.586319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:24.593542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:24.593983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:24.594780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:24.595213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:24.738561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:24.750247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:24.752295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:24.753508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9b266c2a-3143-409b-aaae-80ba32f4006d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.171823 Jun 17 12:55:24.754341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 274/588] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:25.777390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:25.778029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:25.784791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:25.785322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:25.786299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:25.786538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:25.931439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:25.940278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:25.941876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:25.943031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4d55ebfc-fd7f-4fe1-8ce7-30821609af52 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.169785 Jun 17 12:55:25.943606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 315/589] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:26.964025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:26.964626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:26.968347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=38 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:26.972405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:26.972844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:26.973712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:26.974139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:27.110544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:27.119756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:27.121287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:27.122460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6b5610b7-9ea5-4f78-a3a7-705ada0763fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.164123 Jun 17 12:55:27.123028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 275/590] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:26 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:28.142781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:28.143563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:28.151757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:28.152275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:28.153318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:28.153820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:28.287706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:28.297180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:28.298731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:28.299918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71407016-ae3c-4e23-827f-3eb72509d955 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1810 microversion: 2.20 time: 0.161658 Jun 17 12:55:28.300485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 316/591] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:29.318588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:29.319179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:29.326127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:29.326569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:29.327338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:29.327785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:29.474775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:29.484153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:29.485656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:29.486830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-137b56bd-6722-45a1-9094-3b86cf6d03d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1797 microversion: 2.20 time: 0.172365 Jun 17 12:55:29.487384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 276/592] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 12:55:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1797 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:55:38.586445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1aa569a5-1d57-42a1-8114-81492c315e86 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02972020-3095-4b5a-abbb-a873606484f8", "device": "/dev/sdb"}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:55:38.588079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1aa569a5-1d57-42a1-8114-81492c315e86 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:38.590634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=19 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:38.591290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=30 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:38.597115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1aa569a5-1d57-42a1-8114-81492c315e86 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:38.597561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1aa569a5-1d57-42a1-8114-81492c315e86 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:38.598338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1aa569a5-1d57-42a1-8114-81492c315e86 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:38.598796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1aa569a5-1d57-42a1-8114-81492c315e86 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:38.892880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1aa569a5-1d57-42a1-8114-81492c315e86 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "POST /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310251 Jun 17 12:55:38.893580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 317/593] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 12:55:38 2022] POST /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:55:42.411951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-41548b2a-3c90-459a-af3c-6c9214958189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "625a8a3e-6743-46f5-9ea1-2a5a66aac92d"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:55:42.413692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-41548b2a-3c90-459a-af3c-6c9214958189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:42.417422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:42.418632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=46 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:42.427552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41548b2a-3c90-459a-af3c-6c9214958189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:42.428119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41548b2a-3c90-459a-af3c-6c9214958189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:42.428946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41548b2a-3c90-459a-af3c-6c9214958189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:42.429385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41548b2a-3c90-459a-af3c-6c9214958189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:42.786634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-41548b2a-3c90-459a-af3c-6c9214958189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381245 Jun 17 12:55:42.787242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 277/594] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 12:55:42 2022] POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:55:42.902906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bae30cf6-a22b-4f56-ac35-da1060de7d70 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:42.903482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bae30cf6-a22b-4f56-ac35-da1060de7d70 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:42.910127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bae30cf6-a22b-4f56-ac35-da1060de7d70 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:42.910566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bae30cf6-a22b-4f56-ac35-da1060de7d70 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:42.911296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bae30cf6-a22b-4f56-ac35-da1060de7d70 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:42.911840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bae30cf6-a22b-4f56-ac35-da1060de7d70 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:42.935057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bae30cf6-a22b-4f56-ac35-da1060de7d70 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05/ips" status: 200 len: 149 microversion: 2.1 time: 0.036797 Jun 17 12:55:42.935605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 318/595] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 12:55:42 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:55:42.946987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55fae383-05f4-4526-b7f3-e026b6860d6c"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:55:42.948286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:42.955500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:42.955952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:42.956729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:42.957164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:43.038346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Invalid volume: volume 55fae383-05f4-4526-b7f3-e026b6860d6c is already attached to instances: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: POST /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05/os-volume_attachments HTTP/1.1 Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 74 Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 12:55:43.040157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {"volumeAttachment": {"volumeId": "55fae383-05f4-4526-b7f3-e026b6860d6c"}} Jun 17 12:55:43.043391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: volume 55fae383-05f4-4526-b7f3-e026b6860d6c is already attached to instances: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': '20dafd2a-15d7-4ada-b421-c051e3998e05', 'body': {'volumeAttachment': {'volumeId': '55fae383-05f4-4526-b7f3-e026b6860d6c'}}} Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 55fae383-05f4-4526-b7f3-e026b6860d6c is already attached to instances: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:55:43.044305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 55fae383-05f4-4526-b7f3-e026b6860d6c is already attached to instances: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:55:43.045713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 55fae383-05f4-4526-b7f3-e026b6860d6c is already attached to instances: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 400 to user: Invalid volume: volume 55fae383-05f4-4526-b7f3-e026b6860d6c is already attached to instances: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b4b4fe56-b2dd-48d2-90a2-28b03ff12107 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099183 Jun 17 12:55:43.047212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 278/596] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 12:55:42 2022] POST /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 12:55:43.053240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:43.053719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:43.060153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:43.060593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:43.061406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:43.061772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:43.086787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 12:55:43.170974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ac2dc518-9270-41bf-abb3-eaba64037141 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 204 len: 0 microversion: 2.1 time: 0.121038 Jun 17 12:55:43.171529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 319/597] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 12:55:43 2022] DELETE /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:55:43.179565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:43.180204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:43.189519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:43.189894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:43.190666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:43.191097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:43.324431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:43.332276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-73f82283-8119-41b3-87e1-4b13fd5dc6c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.156713 Jun 17 12:55:43.332866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 279/598] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:43 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:44.352993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:44.353756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:44.361781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:44.362284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:44.363425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:44.363673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:44.514739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:44.522795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9d3b1bb4-913d-4208-908c-4ccc18b4595c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.175281 Jun 17 12:55:44.523401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 320/599] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:44 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:45.544605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:45.545361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:45.553794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:45.554239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:45.555001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:45.555428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:45.699730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:45.711448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8627ca7b-02ae-479f-af1b-ad889a88954d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.171993 Jun 17 12:55:45.712291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 280/600] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:45 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:46.734865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:46.735904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:46.744407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:46.744854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:46.745614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:46.746053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:46.876164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:46.888766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b85c1f6c-d29e-48d7-b08e-21d288dd9365 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.161241 Jun 17 12:55:46.889540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 321/601] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:46 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:47.910299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:47.911420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:47.918685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:47.919126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:47.919919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:47.920349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:48.056962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:48.068845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e76c5fd3-2dc3-4de5-9da4-1ea5a2b7f6ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.164701 Jun 17 12:55:48.069559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 281/602] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:47 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:49.086801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:49.087400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:49.095120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:49.095622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:49.096378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:49.096826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:49.239625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:49.248042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-347e82fd-9488-4af1-9320-175a1998c502 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.165629 Jun 17 12:55:49.248623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 322/603] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:49 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:50.265749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:50.267048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:50.273842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:50.274293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:50.275130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:50.275578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:50.414523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:50.426358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c0f037bc-ddc3-476e-a987-5f8e8a03115a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.164265 Jun 17 12:55:50.427129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 282/604] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:50 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:51.448692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:51.449291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:51.459602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:51.460066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:51.460812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:51.461234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:51.600570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:51.609062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-66c844d6-2923-457f-af21-44a41a55f58a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.167039 Jun 17 12:55:51.609621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 323/605] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:51 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:52.630406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:52.631272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:52.638678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:52.639125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:52.639921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:52.640357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:52.775709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:52.783413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-05ea9a8d-ea08-4f77-ac4b-f7f9f6a99d37 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.159732 Jun 17 12:55:52.784005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 283/606] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:52 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:53.800909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:53.801472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:53.808645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:53.809081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:53.809832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:53.810225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:54.164132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:54.172262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-19dd152c-7ca6-4829-a7c0-7c0aedce8f8e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.375157 Jun 17 12:55:54.172799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 324/607] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:53 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:55.193348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:55.193946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:55.201180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:55.201659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:55.202660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:55.203098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:55.352242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:55.360373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4119c18f-2195-4b72-af62-25ad26327834 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.173655 Jun 17 12:55:55.360975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 284/608] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:55 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:56.383107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:56.384259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:56.391913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:56.392356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:56.393131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:56.393559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:56.527358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:56.543436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81f37933-c0a8-48b5-a8db-628b1e4f6625 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.166989 Jun 17 12:55:56.544263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 325/609] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:56 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:57.564959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:57.565738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:57.574385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:57.574833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:57.575651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:57.576081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:57.715986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:57.723539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-654134fa-8a2c-47e4-ab4e-1f52a41a3419 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.165057 Jun 17 12:55:57.724101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 285/610] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:57 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:58.741151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:58.741819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:58.749038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:58.749485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:58.750249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:58.750831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:58.890198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:55:58.899669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bda5c96b-fc32-46ab-8673-781797824229 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.162300 Jun 17 12:55:58.900238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 326/611] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:58 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:55:59.922107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:59.923094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:55:59.934076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:59.934853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:59.936355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:59.937171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:00.079347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:00.088689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ec39f20c-387f-4b34-81e8-8d27a6c42be2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.172996 Jun 17 12:56:00.089515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 286/612] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:55:59 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:01.109359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:01.110454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:01.123293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:01.124075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:01.125162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:01.125804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:01.280881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:01.289094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-46e75074-a568-40ef-93d7-bb7614d61098 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1681 microversion: 2.1 time: 0.184868 Jun 17 12:56:01.290413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 327/613] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:01 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:01.907246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-c1f1085e-5e8b-4ed7-ae40-59f297acf53f req-29be278e-4826-4190-bdf8-25a0327351d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20dafd2a-15d7-4ada-b421-c051e3998e05", "name": "network-vif-deleted", "tag": "e123181a-e3e0-4499-9821-44daff95c0bc"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:56:01.917134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c1f1085e-5e8b-4ed7-ae40-59f297acf53f req-29be278e-4826-4190-bdf8-25a0327351d9 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:01.917916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c1f1085e-5e8b-4ed7-ae40-59f297acf53f req-29be278e-4826-4190-bdf8-25a0327351d9 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:01.940702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-c1f1085e-5e8b-4ed7-ae40-59f297acf53f req-29be278e-4826-4190-bdf8-25a0327351d9 service nova] Creating event network-vif-deleted:e123181a-e3e0-4499-9821-44daff95c0bc for instance 20dafd2a-15d7-4ada-b421-c051e3998e05 on hv-cinder-84617 Jun 17 12:56:01.946703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-c1f1085e-5e8b-4ed7-ae40-59f297acf53f req-29be278e-4826-4190-bdf8-25a0327351d9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042980 Jun 17 12:56:01.948615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 287/614] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:02.307595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:02.308213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:02.315006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:02.315484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:02.316257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:02.316684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:02.364401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:02.364859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:02.365316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lazy-loading 'fault' on Instance uuid 20dafd2a-15d7-4ada-b421-c051e3998e05 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:56:02.411539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:02.421045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4b2c606b-4bd8-4ccb-ade5-8157392833d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 200 len: 1331 microversion: 2.1 time: 0.117051 Jun 17 12:56:02.421676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 328/615] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:02 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:03.440494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:03.441159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:03.448589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:03.449030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:03.449804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:03.450229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:03.464436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 HTTP/1.1 Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 12:56:03.466149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 12:56:03.467549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '20dafd2a-15d7-4ada-b421-c051e3998e05'} Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:56:03.468303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 12:56:03.469441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:56:03.470500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:56:03.470500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bf6c5910-c41e-44d5-8b27-7083f118929a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 404 len: 111 microversion: 2.1 time: 0.032029 Jun 17 12:56:03.470500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 288/616] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:03 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:56:03.477609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-959e3c96-e353-4fce-adc5-e9fb57c80520 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '.version_select at 0x7f454ea2c310>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:03.499653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-959e3c96-e353-4fce-adc5-e9fb57c80520 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718725434" status: 202 len: 0 microversion: 2.1 time: 0.026482 Jun 17 12:56:03.500196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 329/617] 10.222.0.87 () {58 vars in 1220 bytes} [Fri Jun 17 12:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718725434 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:56:04.217618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:04.218112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:04.224690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:04.225137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:04.225890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:04.226317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:04.349075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lazy-loading 'services' on Instance uuid 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:56:04.467999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3f07c815-9c45-4d25-b3d2-c9d2d29b4542 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments/55fae383-05f4-4526-b7f3-e026b6860d6c" status: 202 len: 0 microversion: 2.1 time: 0.254181 Jun 17 12:56:04.468929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 289/618] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 12:56:04 2022] DELETE /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments/55fae383-05f4-4526-b7f3-e026b6860d6c => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:56:04.478098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-df243f2c-ec7f-4627-a5e7-23075de85688 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:04.479026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-df243f2c-ec7f-4627-a5e7-23075de85688 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:04.486654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df243f2c-ec7f-4627-a5e7-23075de85688 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:04.487108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df243f2c-ec7f-4627-a5e7-23075de85688 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:04.488104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df243f2c-ec7f-4627-a5e7-23075de85688 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:04.488542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df243f2c-ec7f-4627-a5e7-23075de85688 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:04.520550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-df243f2c-ec7f-4627-a5e7-23075de85688 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Jun 17 12:56:04.521772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 330/619] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:05.539666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-677100c6-9b80-4789-a31c-b784d38955a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:05.541297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-677100c6-9b80-4789-a31c-b784d38955a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:05.556909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677100c6-9b80-4789-a31c-b784d38955a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:05.557358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677100c6-9b80-4789-a31c-b784d38955a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:05.558139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677100c6-9b80-4789-a31c-b784d38955a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:05.558572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677100c6-9b80-4789-a31c-b784d38955a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:05.588063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-677100c6-9b80-4789-a31c-b784d38955a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056767 Jun 17 12:56:05.588879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 290/620] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:05.823909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:05.824491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:05.831502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:05.831969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:05.832779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:05.833237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:05.891057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:05.960835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lazy-loading 'services' on Instance uuid 57e80959-0f5b-4f32-934a-f939416afe0a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:56:06.087277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-005681f4-fadc-4f0d-ad3b-73c6a8f47b00 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments/16419ea1-b948-4f34-a5ec-589be8aff045" status: 202 len: 0 microversion: 2.1 time: 0.268988 Jun 17 12:56:06.087834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 331/621] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 12:56:05 2022] DELETE /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments/16419ea1-b948-4f34-a5ec-589be8aff045 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:56:06.603803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d4f4b05c-aa3a-4799-a0da-ffce40363572 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:06.604781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d4f4b05c-aa3a-4799-a0da-ffce40363572 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:06.612434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f4b05c-aa3a-4799-a0da-ffce40363572 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:06.612906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f4b05c-aa3a-4799-a0da-ffce40363572 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:06.613713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f4b05c-aa3a-4799-a0da-ffce40363572 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:06.614154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f4b05c-aa3a-4799-a0da-ffce40363572 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:06.645811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d4f4b05c-aa3a-4799-a0da-ffce40363572 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048195 Jun 17 12:56:06.646295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 291/622] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:07.659843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-75e4032e-de46-4220-ba43-0576c7ca30df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:07.660846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-75e4032e-de46-4220-ba43-0576c7ca30df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:07.668464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e4032e-de46-4220-ba43-0576c7ca30df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:07.668912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e4032e-de46-4220-ba43-0576c7ca30df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:07.669689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e4032e-de46-4220-ba43-0576c7ca30df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:07.670106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75e4032e-de46-4220-ba43-0576c7ca30df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:07.704271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-75e4032e-de46-4220-ba43-0576c7ca30df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049258 Jun 17 12:56:07.704822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 332/623] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:08.717420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b3620c8b-42da-456b-bdc0-2d8136c10bca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:08.718362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b3620c8b-42da-456b-bdc0-2d8136c10bca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:08.725333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3620c8b-42da-456b-bdc0-2d8136c10bca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:08.725789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3620c8b-42da-456b-bdc0-2d8136c10bca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:08.726550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3620c8b-42da-456b-bdc0-2d8136c10bca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:08.726982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3620c8b-42da-456b-bdc0-2d8136c10bca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:08.752823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:08.757937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b3620c8b-42da-456b-bdc0-2d8136c10bca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Jun 17 12:56:08.758493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 292/624] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:08.786073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eb83ea2b-cf04-406f-aa93-7146356ec56d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:08.786612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eb83ea2b-cf04-406f-aa93-7146356ec56d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:08.790140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:08.796761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83ea2b-cf04-406f-aa93-7146356ec56d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:08.797206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83ea2b-cf04-406f-aa93-7146356ec56d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:08.797971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83ea2b-cf04-406f-aa93-7146356ec56d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:08.798404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83ea2b-cf04-406f-aa93-7146356ec56d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:08.828887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eb83ea2b-cf04-406f-aa93-7146356ec56d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments/a396d33a-7d09-476a-b1ff-b4cf30f7af6a" status: 200 len: 194 microversion: 2.20 time: 0.049352 Jun 17 12:56:08.829462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 333/625] 10.222.0.87 () {60 vars in 1453 bytes} [Fri Jun 17 12:56:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments/a396d33a-7d09-476a-b1ff-b4cf30f7af6a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:08.896394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:08.896881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:08.904398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:08.904845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:08.905599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:08.906028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:08.997182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lazy-loading 'services' on Instance uuid a700d72f-235d-44b5-a1e5-45ba058ebc43 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:56:09.075921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b426890c-915b-44a1-ba38-4d6d2e8e3090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments/a396d33a-7d09-476a-b1ff-b4cf30f7af6a" status: 202 len: 0 microversion: 2.20 time: 0.183277 Jun 17 12:56:09.076505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 293/626] 10.222.0.87 () {60 vars in 1456 bytes} [Fri Jun 17 12:56:08 2022] DELETE /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments/a396d33a-7d09-476a-b1ff-b4cf30f7af6a => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:56:09.084993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-557917ac-3bb2-4376-8000-b2b7d39db6b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:09.085912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-557917ac-3bb2-4376-8000-b2b7d39db6b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:09.092666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-557917ac-3bb2-4376-8000-b2b7d39db6b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:09.093103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-557917ac-3bb2-4376-8000-b2b7d39db6b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:09.093868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-557917ac-3bb2-4376-8000-b2b7d39db6b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:09.094265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-557917ac-3bb2-4376-8000-b2b7d39db6b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:09.124773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-557917ac-3bb2-4376-8000-b2b7d39db6b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043683 Jun 17 12:56:09.125325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 334/627] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:09.770809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d0f91b3f-4cbb-4e38-a754-6b9854a2d70d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:09.771966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d0f91b3f-4cbb-4e38-a754-6b9854a2d70d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:09.779205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0f91b3f-4cbb-4e38-a754-6b9854a2d70d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:09.779685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0f91b3f-4cbb-4e38-a754-6b9854a2d70d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:09.780449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0f91b3f-4cbb-4e38-a754-6b9854a2d70d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:09.780884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0f91b3f-4cbb-4e38-a754-6b9854a2d70d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:09.810559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d0f91b3f-4cbb-4e38-a754-6b9854a2d70d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Jun 17 12:56:09.811099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 294/628] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:10.138622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-134e9809-9c31-4bac-aaf7-77ec4053de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:10.139807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-134e9809-9c31-4bac-aaf7-77ec4053de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:10.148108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-134e9809-9c31-4bac-aaf7-77ec4053de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:10.148671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-134e9809-9c31-4bac-aaf7-77ec4053de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:10.149823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-134e9809-9c31-4bac-aaf7-77ec4053de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:10.150411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-134e9809-9c31-4bac-aaf7-77ec4053de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:10.181646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-134e9809-9c31-4bac-aaf7-77ec4053de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048018 Jun 17 12:56:10.182216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 335/629] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:10.822634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6e8c85aa-d822-422a-b6f2-63861adfd934 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:10.823701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6e8c85aa-d822-422a-b6f2-63861adfd934 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:10.830990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6e8c85aa-d822-422a-b6f2-63861adfd934 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:10.831465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6e8c85aa-d822-422a-b6f2-63861adfd934 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:10.832227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6e8c85aa-d822-422a-b6f2-63861adfd934 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:10.832663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6e8c85aa-d822-422a-b6f2-63861adfd934 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:10.862359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6e8c85aa-d822-422a-b6f2-63861adfd934 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Jun 17 12:56:10.862945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 295/630] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:11.197330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8ad7f846-c8f7-4663-ab22-c7efd8e1cfc9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:11.198244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8ad7f846-c8f7-4663-ab22-c7efd8e1cfc9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:11.205851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ad7f846-c8f7-4663-ab22-c7efd8e1cfc9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:11.206293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ad7f846-c8f7-4663-ab22-c7efd8e1cfc9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:11.207051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ad7f846-c8f7-4663-ab22-c7efd8e1cfc9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:11.207509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ad7f846-c8f7-4663-ab22-c7efd8e1cfc9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:11.238543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8ad7f846-c8f7-4663-ab22-c7efd8e1cfc9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047194 Jun 17 12:56:11.239361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 336/631] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:11.877517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-53039da7-e88d-4408-8f43-9e33f721e672 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:11.878928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-53039da7-e88d-4408-8f43-9e33f721e672 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:11.888921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53039da7-e88d-4408-8f43-9e33f721e672 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:11.889379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53039da7-e88d-4408-8f43-9e33f721e672 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:11.890159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53039da7-e88d-4408-8f43-9e33f721e672 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:11.890579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-53039da7-e88d-4408-8f43-9e33f721e672 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:11.920507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-53039da7-e88d-4408-8f43-9e33f721e672 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049822 Jun 17 12:56:11.921053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 296/632] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:12.255157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ebd1e9e6-5057-4203-8252-99b6a143659b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:12.256788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ebd1e9e6-5057-4203-8252-99b6a143659b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:12.267967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd1e9e6-5057-4203-8252-99b6a143659b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:12.268711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd1e9e6-5057-4203-8252-99b6a143659b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:12.269964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd1e9e6-5057-4203-8252-99b6a143659b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:12.270684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebd1e9e6-5057-4203-8252-99b6a143659b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:12.309031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ebd1e9e6-5057-4203-8252-99b6a143659b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060320 Jun 17 12:56:12.309472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 337/633] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:12.936617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-524bae59-07cd-4df9-8a18-11cd1d349093 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:12.937765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-524bae59-07cd-4df9-8a18-11cd1d349093 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:12.940801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=41 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:12.947455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-524bae59-07cd-4df9-8a18-11cd1d349093 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:12.948045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-524bae59-07cd-4df9-8a18-11cd1d349093 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:12.948955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-524bae59-07cd-4df9-8a18-11cd1d349093 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:12.949601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-524bae59-07cd-4df9-8a18-11cd1d349093 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:12.983227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-524bae59-07cd-4df9-8a18-11cd1d349093 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052721 Jun 17 12:56:12.983796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 297/634] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:13.324739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f42a8f7c-8b93-440b-9943-0046f2e505c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:13.326106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f42a8f7c-8b93-440b-9943-0046f2e505c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:13.334599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f42a8f7c-8b93-440b-9943-0046f2e505c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:13.335095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f42a8f7c-8b93-440b-9943-0046f2e505c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:13.335982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f42a8f7c-8b93-440b-9943-0046f2e505c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:13.336474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f42a8f7c-8b93-440b-9943-0046f2e505c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:13.368578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f42a8f7c-8b93-440b-9943-0046f2e505c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050936 Jun 17 12:56:13.369124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 338/635] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:13.999463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-818a97b1-3f6f-4b35-8049-18420e397658 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:14.000996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-818a97b1-3f6f-4b35-8049-18420e397658 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:14.011102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-818a97b1-3f6f-4b35-8049-18420e397658 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:14.011922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-818a97b1-3f6f-4b35-8049-18420e397658 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:14.013292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-818a97b1-3f6f-4b35-8049-18420e397658 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:14.014097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-818a97b1-3f6f-4b35-8049-18420e397658 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:14.043035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-818a97b1-3f6f-4b35-8049-18420e397658 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051250 Jun 17 12:56:14.043621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 298/636] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:14.384843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d8e349ff-0ad9-4def-8386-c474de873acc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:14.386247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d8e349ff-0ad9-4def-8386-c474de873acc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:14.398051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8e349ff-0ad9-4def-8386-c474de873acc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:14.398797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8e349ff-0ad9-4def-8386-c474de873acc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:14.400087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8e349ff-0ad9-4def-8386-c474de873acc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:14.400799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8e349ff-0ad9-4def-8386-c474de873acc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:14.431676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d8e349ff-0ad9-4def-8386-c474de873acc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053753 Jun 17 12:56:14.432234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 339/637] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:15.058521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df4c8c0c-9428-4587-81c6-8c8e594e1b12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:15.060055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df4c8c0c-9428-4587-81c6-8c8e594e1b12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:15.067419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4c8c0c-9428-4587-81c6-8c8e594e1b12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:15.067900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4c8c0c-9428-4587-81c6-8c8e594e1b12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:15.068633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4c8c0c-9428-4587-81c6-8c8e594e1b12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:15.069105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4c8c0c-9428-4587-81c6-8c8e594e1b12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:15.099096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df4c8c0c-9428-4587-81c6-8c8e594e1b12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 Jun 17 12:56:15.099689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 299/638] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:15.448249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cd8ab586-b832-4c72-847b-cc0bf382fd3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:15.450833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cd8ab586-b832-4c72-847b-cc0bf382fd3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:15.458305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd8ab586-b832-4c72-847b-cc0bf382fd3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:15.458759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd8ab586-b832-4c72-847b-cc0bf382fd3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:15.459566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd8ab586-b832-4c72-847b-cc0bf382fd3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:15.459996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd8ab586-b832-4c72-847b-cc0bf382fd3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:15.490477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cd8ab586-b832-4c72-847b-cc0bf382fd3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049051 Jun 17 12:56:15.491045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 340/639] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:16.115631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-140c9348-1388-456a-ac16-fe2e4fe0e5b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:16.117121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-140c9348-1388-456a-ac16-fe2e4fe0e5b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:16.126353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-140c9348-1388-456a-ac16-fe2e4fe0e5b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:16.126797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-140c9348-1388-456a-ac16-fe2e4fe0e5b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:16.127686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-140c9348-1388-456a-ac16-fe2e4fe0e5b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:16.128118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-140c9348-1388-456a-ac16-fe2e4fe0e5b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:16.158701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-140c9348-1388-456a-ac16-fe2e4fe0e5b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049708 Jun 17 12:56:16.159256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 300/640] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:16.502819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-36b44b4e-a826-46cb-8063-0375b6cc7791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:16.503791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-36b44b4e-a826-46cb-8063-0375b6cc7791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:16.510518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-36b44b4e-a826-46cb-8063-0375b6cc7791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:16.510955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-36b44b4e-a826-46cb-8063-0375b6cc7791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:16.511742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-36b44b4e-a826-46cb-8063-0375b6cc7791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:16.512165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-36b44b4e-a826-46cb-8063-0375b6cc7791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:16.541780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-36b44b4e-a826-46cb-8063-0375b6cc7791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043054 Jun 17 12:56:16.542329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 341/641] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:17.170906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1605170d-f3cb-4a89-8905-55946c323305 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:17.171902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1605170d-f3cb-4a89-8905-55946c323305 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:17.178784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1605170d-f3cb-4a89-8905-55946c323305 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:17.179225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1605170d-f3cb-4a89-8905-55946c323305 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:17.180006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1605170d-f3cb-4a89-8905-55946c323305 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:17.180467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1605170d-f3cb-4a89-8905-55946c323305 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:17.210581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1605170d-f3cb-4a89-8905-55946c323305 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Jun 17 12:56:17.211130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 301/642] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:17.554221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4be3c1e8-0b56-4f60-9a78-2fe8a6d4c255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:17.555138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4be3c1e8-0b56-4f60-9a78-2fe8a6d4c255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:17.562337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4be3c1e8-0b56-4f60-9a78-2fe8a6d4c255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:17.562780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4be3c1e8-0b56-4f60-9a78-2fe8a6d4c255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:17.563567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4be3c1e8-0b56-4f60-9a78-2fe8a6d4c255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:17.563994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4be3c1e8-0b56-4f60-9a78-2fe8a6d4c255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:17.596074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4be3c1e8-0b56-4f60-9a78-2fe8a6d4c255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045909 Jun 17 12:56:17.596625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 342/643] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:18.222657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-481d58db-c7b5-4b32-8731-8d308978647d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:18.223629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-481d58db-c7b5-4b32-8731-8d308978647d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:18.230539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-481d58db-c7b5-4b32-8731-8d308978647d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.230979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-481d58db-c7b5-4b32-8731-8d308978647d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.231775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-481d58db-c7b5-4b32-8731-8d308978647d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.232651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-481d58db-c7b5-4b32-8731-8d308978647d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.265317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-481d58db-c7b5-4b32-8731-8d308978647d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046350 Jun 17 12:56:18.266093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 302/644] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:18.610339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76acb1b9-0449-465b-9e4c-4e70831e50bf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:18.611261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76acb1b9-0449-465b-9e4c-4e70831e50bf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:18.618498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76acb1b9-0449-465b-9e4c-4e70831e50bf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.618943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76acb1b9-0449-465b-9e4c-4e70831e50bf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.619739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76acb1b9-0449-465b-9e4c-4e70831e50bf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.620168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76acb1b9-0449-465b-9e4c-4e70831e50bf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.650246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76acb1b9-0449-465b-9e4c-4e70831e50bf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045541 Jun 17 12:56:18.650785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 343/645] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:19.281965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-35fd360d-4a9c-44bf-b855-1a08a50da1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:19.283527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-35fd360d-4a9c-44bf-b855-1a08a50da1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:19.294483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35fd360d-4a9c-44bf-b855-1a08a50da1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:19.295471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35fd360d-4a9c-44bf-b855-1a08a50da1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:19.296229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35fd360d-4a9c-44bf-b855-1a08a50da1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:19.296650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35fd360d-4a9c-44bf-b855-1a08a50da1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:19.326442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-35fd360d-4a9c-44bf-b855-1a08a50da1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051450 Jun 17 12:56:19.327093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 303/646] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:19.666596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95f99822-851b-4cea-bd0c-31316c1094c0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:19.668115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95f99822-851b-4cea-bd0c-31316c1094c0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:19.679822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95f99822-851b-4cea-bd0c-31316c1094c0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:19.680566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95f99822-851b-4cea-bd0c-31316c1094c0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:19.681912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95f99822-851b-4cea-bd0c-31316c1094c0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:19.682625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95f99822-851b-4cea-bd0c-31316c1094c0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:19.713510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95f99822-851b-4cea-bd0c-31316c1094c0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053773 Jun 17 12:56:19.714049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 344/647] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:20.344076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa43b102-ced9-440d-9918-24c1599a87e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:20.345054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa43b102-ced9-440d-9918-24c1599a87e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:20.352299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa43b102-ced9-440d-9918-24c1599a87e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:20.352734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa43b102-ced9-440d-9918-24c1599a87e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:20.353552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa43b102-ced9-440d-9918-24c1599a87e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:20.354005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa43b102-ced9-440d-9918-24c1599a87e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:20.385172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa43b102-ced9-440d-9918-24c1599a87e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049283 Jun 17 12:56:20.385725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 304/648] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:20.730825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81a44217-87ea-4eae-a4a7-ca7622b7a773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:20.732754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81a44217-87ea-4eae-a4a7-ca7622b7a773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:20.739776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a44217-87ea-4eae-a4a7-ca7622b7a773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:20.740201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a44217-87ea-4eae-a4a7-ca7622b7a773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:20.740993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a44217-87ea-4eae-a4a7-ca7622b7a773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:20.741421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a44217-87ea-4eae-a4a7-ca7622b7a773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:20.770854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81a44217-87ea-4eae-a4a7-ca7622b7a773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046978 Jun 17 12:56:20.771401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 345/649] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:21.401712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dce94b8f-3b2d-4a3b-87a6-7fa76a0ece85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:21.402937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dce94b8f-3b2d-4a3b-87a6-7fa76a0ece85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:21.410762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dce94b8f-3b2d-4a3b-87a6-7fa76a0ece85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:21.411208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dce94b8f-3b2d-4a3b-87a6-7fa76a0ece85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:21.411979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dce94b8f-3b2d-4a3b-87a6-7fa76a0ece85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:21.412438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dce94b8f-3b2d-4a3b-87a6-7fa76a0ece85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:21.442613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dce94b8f-3b2d-4a3b-87a6-7fa76a0ece85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047573 Jun 17 12:56:21.443400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 305/650] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:21.783959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-451eba16-0ff9-4e1d-a23f-3c4aae6e3136 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:21.785030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-451eba16-0ff9-4e1d-a23f-3c4aae6e3136 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:21.793264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-451eba16-0ff9-4e1d-a23f-3c4aae6e3136 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:21.793789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-451eba16-0ff9-4e1d-a23f-3c4aae6e3136 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:21.794693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-451eba16-0ff9-4e1d-a23f-3c4aae6e3136 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:21.795271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-451eba16-0ff9-4e1d-a23f-3c4aae6e3136 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:21.828011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-451eba16-0ff9-4e1d-a23f-3c4aae6e3136 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049042 Jun 17 12:56:21.828581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 346/651] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:22.459094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc01132b-09fd-41f1-8942-4671fbfe74cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:22.460497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc01132b-09fd-41f1-8942-4671fbfe74cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:22.471653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc01132b-09fd-41f1-8942-4671fbfe74cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:22.472398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc01132b-09fd-41f1-8942-4671fbfe74cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:22.473667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc01132b-09fd-41f1-8942-4671fbfe74cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:22.474385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc01132b-09fd-41f1-8942-4671fbfe74cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:22.507499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc01132b-09fd-41f1-8942-4671fbfe74cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055441 Jun 17 12:56:22.508054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 306/652] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:22.843555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-409de8af-6fd8-4bac-a90f-75e372989ba1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:22.844496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-409de8af-6fd8-4bac-a90f-75e372989ba1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:22.851336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409de8af-6fd8-4bac-a90f-75e372989ba1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:22.851811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409de8af-6fd8-4bac-a90f-75e372989ba1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:22.852569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409de8af-6fd8-4bac-a90f-75e372989ba1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:22.852997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409de8af-6fd8-4bac-a90f-75e372989ba1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:22.869878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:22.884340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-409de8af-6fd8-4bac-a90f-75e372989ba1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047586 Jun 17 12:56:22.884894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 347/653] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:23.522908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6eb20ed3-dc91-4cd6-80fb-9ad9dc7974a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:23.524048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6eb20ed3-dc91-4cd6-80fb-9ad9dc7974a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:23.532756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb20ed3-dc91-4cd6-80fb-9ad9dc7974a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:23.533199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb20ed3-dc91-4cd6-80fb-9ad9dc7974a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:23.533957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb20ed3-dc91-4cd6-80fb-9ad9dc7974a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:23.534387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb20ed3-dc91-4cd6-80fb-9ad9dc7974a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:23.563630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6eb20ed3-dc91-4cd6-80fb-9ad9dc7974a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Jun 17 12:56:23.564176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 307/654] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:23.900270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cad03d89-b25e-4655-b3cf-6c0802728ed0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:23.901722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cad03d89-b25e-4655-b3cf-6c0802728ed0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:23.912746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cad03d89-b25e-4655-b3cf-6c0802728ed0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:23.913550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cad03d89-b25e-4655-b3cf-6c0802728ed0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:23.914780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cad03d89-b25e-4655-b3cf-6c0802728ed0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:23.915472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cad03d89-b25e-4655-b3cf-6c0802728ed0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:23.948466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cad03d89-b25e-4655-b3cf-6c0802728ed0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055065 Jun 17 12:56:23.948930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 348/655] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:24.580982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9fb5dfa3-a7e5-4797-a1e2-586352d1e96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:24.582183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9fb5dfa3-a7e5-4797-a1e2-586352d1e96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:24.590937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fb5dfa3-a7e5-4797-a1e2-586352d1e96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:24.591504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fb5dfa3-a7e5-4797-a1e2-586352d1e96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:24.592447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fb5dfa3-a7e5-4797-a1e2-586352d1e96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:24.592982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fb5dfa3-a7e5-4797-a1e2-586352d1e96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:24.622209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:24.627325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9fb5dfa3-a7e5-4797-a1e2-586352d1e96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052449 Jun 17 12:56:24.627918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 308/656] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:24.965486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a98da325-cf0f-4148-a5ee-8e63ba864414 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:24.966862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a98da325-cf0f-4148-a5ee-8e63ba864414 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:24.974915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a98da325-cf0f-4148-a5ee-8e63ba864414 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:24.975351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a98da325-cf0f-4148-a5ee-8e63ba864414 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:24.976130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a98da325-cf0f-4148-a5ee-8e63ba864414 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:24.976550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a98da325-cf0f-4148-a5ee-8e63ba864414 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:25.007163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a98da325-cf0f-4148-a5ee-8e63ba864414 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048802 Jun 17 12:56:25.007748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 349/657] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:25.645663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-092d4f06-d656-4bbd-af10-d335d91b184f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:25.647150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-092d4f06-d656-4bbd-af10-d335d91b184f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:25.659635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-092d4f06-d656-4bbd-af10-d335d91b184f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:25.660080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-092d4f06-d656-4bbd-af10-d335d91b184f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:25.660840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-092d4f06-d656-4bbd-af10-d335d91b184f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:25.661269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-092d4f06-d656-4bbd-af10-d335d91b184f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:25.691525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-092d4f06-d656-4bbd-af10-d335d91b184f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054439 Jun 17 12:56:25.692076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 309/658] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:26.025315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3a73483a-3583-47a4-8d35-9a605f950081 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:26.026783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3a73483a-3583-47a4-8d35-9a605f950081 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:26.037895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a73483a-3583-47a4-8d35-9a605f950081 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:26.038631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a73483a-3583-47a4-8d35-9a605f950081 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:26.039931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a73483a-3583-47a4-8d35-9a605f950081 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:26.040637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a73483a-3583-47a4-8d35-9a605f950081 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:26.073650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3a73483a-3583-47a4-8d35-9a605f950081 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055116 Jun 17 12:56:26.074198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 350/659] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:26 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:26.706799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5aee83af-9435-42a5-8ff8-bc0d1fa7903c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:26.707738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5aee83af-9435-42a5-8ff8-bc0d1fa7903c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:26.714611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5aee83af-9435-42a5-8ff8-bc0d1fa7903c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:26.715049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5aee83af-9435-42a5-8ff8-bc0d1fa7903c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:26.715844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5aee83af-9435-42a5-8ff8-bc0d1fa7903c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:26.716267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5aee83af-9435-42a5-8ff8-bc0d1fa7903c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:26.746367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5aee83af-9435-42a5-8ff8-bc0d1fa7903c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Jun 17 12:56:26.746904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 310/660] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:27.086577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f016e97-3c83-4dae-a6b4-754185efcf3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:27.087620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f016e97-3c83-4dae-a6b4-754185efcf3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:27.095475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f016e97-3c83-4dae-a6b4-754185efcf3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:27.095923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f016e97-3c83-4dae-a6b4-754185efcf3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:27.096677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f016e97-3c83-4dae-a6b4-754185efcf3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:27.097108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f016e97-3c83-4dae-a6b4-754185efcf3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:27.128539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f016e97-3c83-4dae-a6b4-754185efcf3e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046384 Jun 17 12:56:27.129340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 351/661] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:27.762549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a90d3db1-e5fd-44bb-a670-ed80b623605b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:27.764089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a90d3db1-e5fd-44bb-a670-ed80b623605b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:27.775455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d3db1-e5fd-44bb-a670-ed80b623605b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:27.776237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d3db1-e5fd-44bb-a670-ed80b623605b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:27.777487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d3db1-e5fd-44bb-a670-ed80b623605b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:27.778211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d3db1-e5fd-44bb-a670-ed80b623605b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:27.810989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a90d3db1-e5fd-44bb-a670-ed80b623605b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055220 Jun 17 12:56:27.811585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 311/662] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:28.144096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2eb81aee-a928-4caf-9c6b-b117801779f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:28.145021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2eb81aee-a928-4caf-9c6b-b117801779f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:28.152006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2eb81aee-a928-4caf-9c6b-b117801779f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:28.152454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2eb81aee-a928-4caf-9c6b-b117801779f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:28.153216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2eb81aee-a928-4caf-9c6b-b117801779f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:28.153650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2eb81aee-a928-4caf-9c6b-b117801779f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:28.182886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2eb81aee-a928-4caf-9c6b-b117801779f7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044536 Jun 17 12:56:28.183682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 352/663] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:28.826757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-190c8fa8-9b14-470c-9621-d570cc7a5e13 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:28.828300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-190c8fa8-9b14-470c-9621-d570cc7a5e13 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:28.839706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-190c8fa8-9b14-470c-9621-d570cc7a5e13 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:28.840449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-190c8fa8-9b14-470c-9621-d570cc7a5e13 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:28.841701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-190c8fa8-9b14-470c-9621-d570cc7a5e13 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:28.842498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-190c8fa8-9b14-470c-9621-d570cc7a5e13 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:28.874697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-190c8fa8-9b14-470c-9621-d570cc7a5e13 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054544 Jun 17 12:56:28.875262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 312/664] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:29.199705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d218e93b-2396-4d84-97ea-f3176ad6c1bb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:29.201231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d218e93b-2396-4d84-97ea-f3176ad6c1bb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:29.209350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d218e93b-2396-4d84-97ea-f3176ad6c1bb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:29.209872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d218e93b-2396-4d84-97ea-f3176ad6c1bb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:29.210574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d218e93b-2396-4d84-97ea-f3176ad6c1bb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:29.211000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d218e93b-2396-4d84-97ea-f3176ad6c1bb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:29.240708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d218e93b-2396-4d84-97ea-f3176ad6c1bb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047881 Jun 17 12:56:29.241292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 353/665] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:29.890421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b3a82ecd-5fba-4584-b2b9-a82405692f52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:29.891951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b3a82ecd-5fba-4584-b2b9-a82405692f52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:29.899419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3a82ecd-5fba-4584-b2b9-a82405692f52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:29.899888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3a82ecd-5fba-4584-b2b9-a82405692f52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:29.900637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3a82ecd-5fba-4584-b2b9-a82405692f52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:29.901062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3a82ecd-5fba-4584-b2b9-a82405692f52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:29.930441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b3a82ecd-5fba-4584-b2b9-a82405692f52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046682 Jun 17 12:56:29.931019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 313/666] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:30.256390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-143c9c33-5075-474a-b8f1-361ee1c2f425 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:30.257568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-143c9c33-5075-474a-b8f1-361ee1c2f425 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:30.266026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-143c9c33-5075-474a-b8f1-361ee1c2f425 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:30.266575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-143c9c33-5075-474a-b8f1-361ee1c2f425 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:30.267590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-143c9c33-5075-474a-b8f1-361ee1c2f425 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:30.268129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-143c9c33-5075-474a-b8f1-361ee1c2f425 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:30.302008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-143c9c33-5075-474a-b8f1-361ee1c2f425 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051657 Jun 17 12:56:30.302569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 354/667] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:30.943908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-480a069f-c733-4140-a610-d382b0f8f6a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:30.944939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-480a069f-c733-4140-a610-d382b0f8f6a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:30.952000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-480a069f-c733-4140-a610-d382b0f8f6a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:30.952444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-480a069f-c733-4140-a610-d382b0f8f6a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:30.953221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-480a069f-c733-4140-a610-d382b0f8f6a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:30.953638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-480a069f-c733-4140-a610-d382b0f8f6a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:30.984611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-480a069f-c733-4140-a610-d382b0f8f6a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Jun 17 12:56:30.985165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 314/668] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:31.314695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9c22f649-bf36-410f-a68c-e8d5211c7290 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:31.316223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9c22f649-bf36-410f-a68c-e8d5211c7290 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:31.324959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c22f649-bf36-410f-a68c-e8d5211c7290 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:31.325618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c22f649-bf36-410f-a68c-e8d5211c7290 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:31.326864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c22f649-bf36-410f-a68c-e8d5211c7290 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:31.327314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9c22f649-bf36-410f-a68c-e8d5211c7290 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:31.359723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9c22f649-bf36-410f-a68c-e8d5211c7290 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049551 Jun 17 12:56:31.360270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 355/669] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:32.002531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8238deaa-7a60-4165-830e-633b2a24e9cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:32.004143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8238deaa-7a60-4165-830e-633b2a24e9cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:32.015139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8238deaa-7a60-4165-830e-633b2a24e9cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:32.015969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8238deaa-7a60-4165-830e-633b2a24e9cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:32.017216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8238deaa-7a60-4165-830e-633b2a24e9cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:32.017930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8238deaa-7a60-4165-830e-633b2a24e9cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:32.049346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8238deaa-7a60-4165-830e-633b2a24e9cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053474 Jun 17 12:56:32.049909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 315/670] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:32.376571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4bcd553-1b53-4a9b-a1e9-452bb90e6918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:32.377890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4bcd553-1b53-4a9b-a1e9-452bb90e6918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:32.385568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4bcd553-1b53-4a9b-a1e9-452bb90e6918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:32.386009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4bcd553-1b53-4a9b-a1e9-452bb90e6918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:32.386768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4bcd553-1b53-4a9b-a1e9-452bb90e6918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:32.387196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4bcd553-1b53-4a9b-a1e9-452bb90e6918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:32.417386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4bcd553-1b53-4a9b-a1e9-452bb90e6918 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047657 Jun 17 12:56:32.417945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 356/671] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:33.064786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f007c640-edf3-4b7f-84d7-73302a2f4c29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:33.066168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f007c640-edf3-4b7f-84d7-73302a2f4c29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:33.073437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f007c640-edf3-4b7f-84d7-73302a2f4c29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:33.073871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f007c640-edf3-4b7f-84d7-73302a2f4c29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:33.074630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f007c640-edf3-4b7f-84d7-73302a2f4c29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:33.075056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f007c640-edf3-4b7f-84d7-73302a2f4c29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:33.105076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f007c640-edf3-4b7f-84d7-73302a2f4c29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046603 Jun 17 12:56:33.105628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 316/672] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:33.434549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fdfab3f5-145d-438d-94f9-ca7c786a0ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:33.436330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fdfab3f5-145d-438d-94f9-ca7c786a0ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:33.450445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdfab3f5-145d-438d-94f9-ca7c786a0ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:33.451234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdfab3f5-145d-438d-94f9-ca7c786a0ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:33.452576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdfab3f5-145d-438d-94f9-ca7c786a0ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:33.453286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdfab3f5-145d-438d-94f9-ca7c786a0ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:33.484850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fdfab3f5-145d-438d-94f9-ca7c786a0ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057190 Jun 17 12:56:33.485412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 357/673] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:56:34.117007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0e8a86e0-61bd-4456-a939-0f3282927fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:34.117876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0e8a86e0-61bd-4456-a939-0f3282927fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:34.124822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8a86e0-61bd-4456-a939-0f3282927fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:34.125266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8a86e0-61bd-4456-a939-0f3282927fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:34.126055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8a86e0-61bd-4456-a939-0f3282927fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:34.126461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8a86e0-61bd-4456-a939-0f3282927fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:34.155670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0e8a86e0-61bd-4456-a939-0f3282927fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Jun 17 12:56:34.156220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 317/674] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:34.501162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ee93c601-4707-4a58-84e3-b467274a08cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:34.502642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ee93c601-4707-4a58-84e3-b467274a08cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:34.510223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee93c601-4707-4a58-84e3-b467274a08cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:34.510668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee93c601-4707-4a58-84e3-b467274a08cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:34.511428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee93c601-4707-4a58-84e3-b467274a08cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:34.511886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee93c601-4707-4a58-84e3-b467274a08cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:34.541426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ee93c601-4707-4a58-84e3-b467274a08cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046985 Jun 17 12:56:34.541967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 358/675] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:35.171670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c119a993-51b6-4c6d-9c7c-eb3443d26538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:35.173253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c119a993-51b6-4c6d-9c7c-eb3443d26538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:35.184740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c119a993-51b6-4c6d-9c7c-eb3443d26538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:35.185476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c119a993-51b6-4c6d-9c7c-eb3443d26538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:35.186728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c119a993-51b6-4c6d-9c7c-eb3443d26538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:35.187501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c119a993-51b6-4c6d-9c7c-eb3443d26538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:35.219205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c119a993-51b6-4c6d-9c7c-eb3443d26538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054274 Jun 17 12:56:35.219795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 318/676] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:35.556230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c2640f95-0faa-435b-b27e-84ed57d13ebb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:35.557262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c2640f95-0faa-435b-b27e-84ed57d13ebb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:35.564856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2640f95-0faa-435b-b27e-84ed57d13ebb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:35.565352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2640f95-0faa-435b-b27e-84ed57d13ebb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:35.566197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2640f95-0faa-435b-b27e-84ed57d13ebb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:35.566685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2640f95-0faa-435b-b27e-84ed57d13ebb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:35.597882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c2640f95-0faa-435b-b27e-84ed57d13ebb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046837 Jun 17 12:56:35.598438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 359/677] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:36.235594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6f4eee13-c011-442f-87ce-993051056209 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:36.237137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6f4eee13-c011-442f-87ce-993051056209 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:36.248373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f4eee13-c011-442f-87ce-993051056209 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:36.249117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f4eee13-c011-442f-87ce-993051056209 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:36.250379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f4eee13-c011-442f-87ce-993051056209 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:36.251090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f4eee13-c011-442f-87ce-993051056209 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:36.282536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6f4eee13-c011-442f-87ce-993051056209 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054084 Jun 17 12:56:36.283087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 319/678] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:36.612802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2a6e487e-c63f-42db-9746-db82cb937147 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:36.614091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2a6e487e-c63f-42db-9746-db82cb937147 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:36.621533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a6e487e-c63f-42db-9746-db82cb937147 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:36.621986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a6e487e-c63f-42db-9746-db82cb937147 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:36.622751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a6e487e-c63f-42db-9746-db82cb937147 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:36.623182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a6e487e-c63f-42db-9746-db82cb937147 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:36.653016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2a6e487e-c63f-42db-9746-db82cb937147 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046477 Jun 17 12:56:36.653572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 360/679] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:37.297967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c66a2b1b-2a55-4fb3-a265-d1b4d47ecba2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:37.299364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c66a2b1b-2a55-4fb3-a265-d1b4d47ecba2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:37.307251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c66a2b1b-2a55-4fb3-a265-d1b4d47ecba2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:37.307726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c66a2b1b-2a55-4fb3-a265-d1b4d47ecba2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:37.308487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c66a2b1b-2a55-4fb3-a265-d1b4d47ecba2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:37.308920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c66a2b1b-2a55-4fb3-a265-d1b4d47ecba2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:37.338704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c66a2b1b-2a55-4fb3-a265-d1b4d47ecba2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046982 Jun 17 12:56:37.339252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 320/680] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:37.669882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-579064db-0efb-4d9d-9c20-5746507e627d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:37.671147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-579064db-0efb-4d9d-9c20-5746507e627d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:37.682793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579064db-0efb-4d9d-9c20-5746507e627d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:37.685154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579064db-0efb-4d9d-9c20-5746507e627d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:37.686469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579064db-0efb-4d9d-9c20-5746507e627d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:37.687201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579064db-0efb-4d9d-9c20-5746507e627d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:37.720997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-579064db-0efb-4d9d-9c20-5746507e627d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058228 Jun 17 12:56:37.721564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 361/681] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:38.353810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8b62d400-da1f-412d-ade0-a798ef68018b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:38.355139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8b62d400-da1f-412d-ade0-a798ef68018b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:38.364456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b62d400-da1f-412d-ade0-a798ef68018b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:38.365068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b62d400-da1f-412d-ade0-a798ef68018b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:38.366658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b62d400-da1f-412d-ade0-a798ef68018b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:38.367245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b62d400-da1f-412d-ade0-a798ef68018b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:38.400793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8b62d400-da1f-412d-ade0-a798ef68018b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053207 Jun 17 12:56:38.401336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 321/682] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:38.736407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2725f262-602b-4382-8627-0e68958b51c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:38.737535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2725f262-602b-4382-8627-0e68958b51c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:38.745054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2725f262-602b-4382-8627-0e68958b51c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:38.745520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2725f262-602b-4382-8627-0e68958b51c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:38.746275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2725f262-602b-4382-8627-0e68958b51c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:38.746698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2725f262-602b-4382-8627-0e68958b51c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:38.777154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2725f262-602b-4382-8627-0e68958b51c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046019 Jun 17 12:56:38.777713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 362/683] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:39.413299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dbb06097-7791-41f7-8b6a-3901302c2bf0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:39.414249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dbb06097-7791-41f7-8b6a-3901302c2bf0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:39.423726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbb06097-7791-41f7-8b6a-3901302c2bf0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:39.424394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbb06097-7791-41f7-8b6a-3901302c2bf0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:39.425600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbb06097-7791-41f7-8b6a-3901302c2bf0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:39.426253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbb06097-7791-41f7-8b6a-3901302c2bf0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:39.458136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dbb06097-7791-41f7-8b6a-3901302c2bf0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049037 Jun 17 12:56:39.458971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 322/684] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:39.791126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e81087eb-e092-4d60-af6c-624edadb02c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:39.792061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e81087eb-e092-4d60-af6c-624edadb02c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:39.794488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=60 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:39.800174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e81087eb-e092-4d60-af6c-624edadb02c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:39.800603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e81087eb-e092-4d60-af6c-624edadb02c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:39.801340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e81087eb-e092-4d60-af6c-624edadb02c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:39.801758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e81087eb-e092-4d60-af6c-624edadb02c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:39.831133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e81087eb-e092-4d60-af6c-624edadb02c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044789 Jun 17 12:56:39.831707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 363/685] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:40.710123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5e076d03-bdca-4603-b386-a4ccb8f7d651 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:40.711059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5e076d03-bdca-4603-b386-a4ccb8f7d651 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:40.717540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e076d03-bdca-4603-b386-a4ccb8f7d651 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:40.717976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e076d03-bdca-4603-b386-a4ccb8f7d651 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:40.718739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e076d03-bdca-4603-b386-a4ccb8f7d651 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:40.719171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e076d03-bdca-4603-b386-a4ccb8f7d651 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:40.749431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5e076d03-bdca-4603-b386-a4ccb8f7d651 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.281064 Jun 17 12:56:40.749982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 323/686] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:40.842362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1461ba1c-5373-41d2-b2f7-3426e7b3892b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:40.843276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1461ba1c-5373-41d2-b2f7-3426e7b3892b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:40.850330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1461ba1c-5373-41d2-b2f7-3426e7b3892b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:40.850776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1461ba1c-5373-41d2-b2f7-3426e7b3892b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:40.851573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1461ba1c-5373-41d2-b2f7-3426e7b3892b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:40.852001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1461ba1c-5373-41d2-b2f7-3426e7b3892b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:40.855668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:40.882651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1461ba1c-5373-41d2-b2f7-3426e7b3892b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044287 Jun 17 12:56:40.883178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 364/687] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:41.765640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-daa3c1d1-5215-461d-8e80-1bf82d51b30d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:41.767425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-daa3c1d1-5215-461d-8e80-1bf82d51b30d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:41.776165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-daa3c1d1-5215-461d-8e80-1bf82d51b30d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:41.776645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-daa3c1d1-5215-461d-8e80-1bf82d51b30d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:41.777430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-daa3c1d1-5215-461d-8e80-1bf82d51b30d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:41.777859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-daa3c1d1-5215-461d-8e80-1bf82d51b30d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:41.807506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-daa3c1d1-5215-461d-8e80-1bf82d51b30d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048579 Jun 17 12:56:41.808061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 324/688] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:41.901721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bdcf0f3d-32c5-4e98-86df-9c596d5ea1d3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:41.903181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bdcf0f3d-32c5-4e98-86df-9c596d5ea1d3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:41.913288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdcf0f3d-32c5-4e98-86df-9c596d5ea1d3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:41.913757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdcf0f3d-32c5-4e98-86df-9c596d5ea1d3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:41.914512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdcf0f3d-32c5-4e98-86df-9c596d5ea1d3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:41.914941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdcf0f3d-32c5-4e98-86df-9c596d5ea1d3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:41.944866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bdcf0f3d-32c5-4e98-86df-9c596d5ea1d3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049666 Jun 17 12:56:41.945421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 365/689] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:42.818881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ffc4e69-6e4e-4ed1-8aa2-0128c82a5354 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:42.820359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ffc4e69-6e4e-4ed1-8aa2-0128c82a5354 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:42.827723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e69-6e4e-4ed1-8aa2-0128c82a5354 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:42.828164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e69-6e4e-4ed1-8aa2-0128c82a5354 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:42.828930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e69-6e4e-4ed1-8aa2-0128c82a5354 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:42.829351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e69-6e4e-4ed1-8aa2-0128c82a5354 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:42.849651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:42.864324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ffc4e69-6e4e-4ed1-8aa2-0128c82a5354 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049635 Jun 17 12:56:42.865170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 325/690] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:42.957293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30bfea99-3f4c-4eea-b4b6-827d0ebb6e1a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:42.958203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30bfea99-3f4c-4eea-b4b6-827d0ebb6e1a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:42.965163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30bfea99-3f4c-4eea-b4b6-827d0ebb6e1a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:42.965657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30bfea99-3f4c-4eea-b4b6-827d0ebb6e1a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:42.966423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30bfea99-3f4c-4eea-b4b6-827d0ebb6e1a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:42.966868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30bfea99-3f4c-4eea-b4b6-827d0ebb6e1a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:42.998872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30bfea99-3f4c-4eea-b4b6-827d0ebb6e1a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045667 Jun 17 12:56:43.000015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 366/691] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:56:43.881081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0aad5340-ac1e-4c17-bffe-48ec016d6bac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:43.883175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0aad5340-ac1e-4c17-bffe-48ec016d6bac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:43.886870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=58 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:43.895270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aad5340-ac1e-4c17-bffe-48ec016d6bac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:43.896035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aad5340-ac1e-4c17-bffe-48ec016d6bac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:43.897463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aad5340-ac1e-4c17-bffe-48ec016d6bac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:43.898010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aad5340-ac1e-4c17-bffe-48ec016d6bac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:43.927301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0aad5340-ac1e-4c17-bffe-48ec016d6bac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052838 Jun 17 12:56:43.927881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 326/692] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:44.126229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9bd6489-48b0-4426-b782-71e66920d5b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:44.127188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9bd6489-48b0-4426-b782-71e66920d5b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:44.133866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bd6489-48b0-4426-b782-71e66920d5b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:44.134226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bd6489-48b0-4426-b782-71e66920d5b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:44.134976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bd6489-48b0-4426-b782-71e66920d5b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:44.135412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bd6489-48b0-4426-b782-71e66920d5b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:44.164648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9bd6489-48b0-4426-b782-71e66920d5b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156956 Jun 17 12:56:44.165196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 367/693] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:44.943129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f72ef3e5-c87c-423d-984a-9f970df9012e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:44.944562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f72ef3e5-c87c-423d-984a-9f970df9012e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:44.951402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f72ef3e5-c87c-423d-984a-9f970df9012e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:44.951897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f72ef3e5-c87c-423d-984a-9f970df9012e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:44.952661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f72ef3e5-c87c-423d-984a-9f970df9012e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:44.953099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f72ef3e5-c87c-423d-984a-9f970df9012e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:44.982972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f72ef3e5-c87c-423d-984a-9f970df9012e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047157 Jun 17 12:56:44.983539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 327/694] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:45.181106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-46ffc23c-85ff-4c37-9495-68a8ac3dff82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:45.182517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-46ffc23c-85ff-4c37-9495-68a8ac3dff82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:45.193601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46ffc23c-85ff-4c37-9495-68a8ac3dff82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:45.194256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46ffc23c-85ff-4c37-9495-68a8ac3dff82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:45.195098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46ffc23c-85ff-4c37-9495-68a8ac3dff82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:45.195585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46ffc23c-85ff-4c37-9495-68a8ac3dff82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:45.225209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-46ffc23c-85ff-4c37-9495-68a8ac3dff82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050842 Jun 17 12:56:45.226164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 368/695] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:45.995739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6adb34d5-3f87-40c4-9e2a-ff1ec973f3d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:45.996706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6adb34d5-3f87-40c4-9e2a-ff1ec973f3d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:46.003851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6adb34d5-3f87-40c4-9e2a-ff1ec973f3d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:46.004306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6adb34d5-3f87-40c4-9e2a-ff1ec973f3d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:46.005069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6adb34d5-3f87-40c4-9e2a-ff1ec973f3d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:46.005505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6adb34d5-3f87-40c4-9e2a-ff1ec973f3d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:46.035812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6adb34d5-3f87-40c4-9e2a-ff1ec973f3d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Jun 17 12:56:46.036365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 328/696] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:46.238153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1ad88f8e-2487-43ea-a7e4-da0ef668fa18 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:46.238975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1ad88f8e-2487-43ea-a7e4-da0ef668fa18 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:46.246425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ad88f8e-2487-43ea-a7e4-da0ef668fa18 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:46.246858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ad88f8e-2487-43ea-a7e4-da0ef668fa18 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:46.247641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ad88f8e-2487-43ea-a7e4-da0ef668fa18 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:46.248063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ad88f8e-2487-43ea-a7e4-da0ef668fa18 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:46.278007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1ad88f8e-2487-43ea-a7e4-da0ef668fa18 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044346 Jun 17 12:56:46.278557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 369/697] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:47.049689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-07612652-b1ba-45a3-9870-befbbdf8b971 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:47.050623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-07612652-b1ba-45a3-9870-befbbdf8b971 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:47.057903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07612652-b1ba-45a3-9870-befbbdf8b971 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.058437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07612652-b1ba-45a3-9870-befbbdf8b971 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.059094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07612652-b1ba-45a3-9870-befbbdf8b971 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.059574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07612652-b1ba-45a3-9870-befbbdf8b971 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.089988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-07612652-b1ba-45a3-9870-befbbdf8b971 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044292 Jun 17 12:56:47.090550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 329/698] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:47.223759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:56:47.224136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 12:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:56:47.292893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ed336c58-b4fc-4fb6-a1fc-b9041a74a608 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:47.293752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ed336c58-b4fc-4fb6-a1fc-b9041a74a608 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:47.300704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed336c58-b4fc-4fb6-a1fc-b9041a74a608 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.301151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed336c58-b4fc-4fb6-a1fc-b9041a74a608 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.301914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed336c58-b4fc-4fb6-a1fc-b9041a74a608 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.302345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed336c58-b4fc-4fb6-a1fc-b9041a74a608 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.346509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ed336c58-b4fc-4fb6-a1fc-b9041a74a608 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059403 Jun 17 12:56:47.348856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 370/699] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:47.382247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:56:47.382771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:47.389057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.389512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.390276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.390711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.413847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lazy-loading 'flavor' on Instance uuid 7e78628d-5386-4d24-adb0-9ea06bce2e6f {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:56:47.491509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-439eea54-21b8-48d8-bce0-3ae70bc03c99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "POST /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f/action" status: 202 len: 0 microversion: 2.1 time: 0.115349 Jun 17 12:56:47.492099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 330/700] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:56:47 2022] POST /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:56:47.500801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:47.501400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:47.507745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.508312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.509110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:47.509563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:47.782283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:47.790741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-66186fdd-609b-43ba-8cac-299fe6a3b3b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.294054 Jun 17 12:56:47.791310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 371/701] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:48.102306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9798c5a4-0ee6-4320-b997-3771a2fbe1cc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:48.103580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9798c5a4-0ee6-4320-b997-3771a2fbe1cc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:48.110938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9798c5a4-0ee6-4320-b997-3771a2fbe1cc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.111364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9798c5a4-0ee6-4320-b997-3771a2fbe1cc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.112260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9798c5a4-0ee6-4320-b997-3771a2fbe1cc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.112740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9798c5a4-0ee6-4320-b997-3771a2fbe1cc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.146028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9798c5a4-0ee6-4320-b997-3771a2fbe1cc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048573 Jun 17 12:56:48.146578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 331/702] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:48.366280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6131a0bb-0fa4-41e7-ab14-313fcfa249db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:48.367116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6131a0bb-0fa4-41e7-ab14-313fcfa249db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:48.374025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6131a0bb-0fa4-41e7-ab14-313fcfa249db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.374495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6131a0bb-0fa4-41e7-ab14-313fcfa249db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.375258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6131a0bb-0fa4-41e7-ab14-313fcfa249db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.375882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6131a0bb-0fa4-41e7-ab14-313fcfa249db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.410989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6131a0bb-0fa4-41e7-ab14-313fcfa249db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051928 Jun 17 12:56:48.411601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 372/703] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:48.798278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:56:48.799274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:48.807510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.807949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.808073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:48.808659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:48.808771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.809111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.814813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.815311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.816102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:48.816527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:48.834006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'flavor' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:56:48.989414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:48.997130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7c06e543-84f2-4591-92c0-b0596935f2ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.193451 Jun 17 12:56:48.997699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 373/704] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:56:49.020111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a53f356a-561a-431c-996b-f970692df6dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/action" status: 200 len: 32 microversion: 2.1 time: 0.225974 Jun 17 12:56:49.020711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 332/705] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:56:48 2022] POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 12:56:49.030169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:49.030774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:49.037576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:49.038120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:49.039028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:49.039486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:49.157843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cabc4096-9db3-4cf8-81f7-7a57f777f5c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:49.158833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cabc4096-9db3-4cf8-81f7-7a57f777f5c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:49.166188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cabc4096-9db3-4cf8-81f7-7a57f777f5c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:49.166636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cabc4096-9db3-4cf8-81f7-7a57f777f5c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:49.167405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cabc4096-9db3-4cf8-81f7-7a57f777f5c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:49.167852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cabc4096-9db3-4cf8-81f7-7a57f777f5c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:49.175143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:49.184066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8a8a7a80-49c3-4819-9481-c82af0a8e451 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.157718 Jun 17 12:56:49.184619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 374/706] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:49 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:49.198436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cabc4096-9db3-4cf8-81f7-7a57f777f5c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Jun 17 12:56:49.198986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 333/707] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:49.423716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d216b313-0331-41e6-a717-8cfd54941ac2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:49.424546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d216b313-0331-41e6-a717-8cfd54941ac2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:49.431859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d216b313-0331-41e6-a717-8cfd54941ac2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:49.432309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d216b313-0331-41e6-a717-8cfd54941ac2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:49.433073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d216b313-0331-41e6-a717-8cfd54941ac2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:49.433484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d216b313-0331-41e6-a717-8cfd54941ac2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:49.463328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d216b313-0331-41e6-a717-8cfd54941ac2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043834 Jun 17 12:56:49.463930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 375/708] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:50.014464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:50.015058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:50.021420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.021946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.022836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.023264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.161213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:50.170091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7e2a736d-8712-4f43-b04f-b69fab553abd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.159674 Jun 17 12:56:50.170632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 334/709] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:50.201793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:50.202399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:50.208824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.209274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.210012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-343c788c-eb14-4cc9-8530-d8a63acfd2d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:50.210286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.210728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.210949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-343c788c-eb14-4cc9-8530-d8a63acfd2d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:50.217083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-343c788c-eb14-4cc9-8530-d8a63acfd2d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.217530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-343c788c-eb14-4cc9-8530-d8a63acfd2d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.218294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-343c788c-eb14-4cc9-8530-d8a63acfd2d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.218731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-343c788c-eb14-4cc9-8530-d8a63acfd2d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.248763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-343c788c-eb14-4cc9-8530-d8a63acfd2d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Jun 17 12:56:50.249293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 335/710] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:56:50.350801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:50.359871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-939c9053-d4af-4315-a7a4-a14701fbdb44 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.161970 Jun 17 12:56:50.360479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 376/711] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:50.477900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-59deb989-c4c8-447e-9948-5aa46c98224c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:50.478958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-59deb989-c4c8-447e-9948-5aa46c98224c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:50.485954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59deb989-c4c8-447e-9948-5aa46c98224c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.486393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59deb989-c4c8-447e-9948-5aa46c98224c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.487148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59deb989-c4c8-447e-9948-5aa46c98224c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:50.487773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59deb989-c4c8-447e-9948-5aa46c98224c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:50.517405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-59deb989-c4c8-447e-9948-5aa46c98224c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045162 Jun 17 12:56:50.517975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 336/712] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:51.187789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:51.188388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:51.196736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.197196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.197942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.198369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.260909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-460efc5e-54a3-4fc9-98b6-6ad0eb6ed17a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:51.261931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-460efc5e-54a3-4fc9-98b6-6ad0eb6ed17a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:51.268762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-460efc5e-54a3-4fc9-98b6-6ad0eb6ed17a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.269309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-460efc5e-54a3-4fc9-98b6-6ad0eb6ed17a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.270153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-460efc5e-54a3-4fc9-98b6-6ad0eb6ed17a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.270631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-460efc5e-54a3-4fc9-98b6-6ad0eb6ed17a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.301389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-460efc5e-54a3-4fc9-98b6-6ad0eb6ed17a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Jun 17 12:56:51.301952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 337/713] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:51.331872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:51.339948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1fcbea88-33a9-4433-ae78-4e89d928fad7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.156080 Jun 17 12:56:51.340510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 377/714] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:51.383838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:51.384439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:51.390977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.391410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.392198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.392624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.396708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:51.529730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-27245f79-5a89-4c7f-b908-e941ea4cf5d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:51.530993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-27245f79-5a89-4c7f-b908-e941ea4cf5d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:51.537373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27245f79-5a89-4c7f-b908-e941ea4cf5d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.537861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27245f79-5a89-4c7f-b908-e941ea4cf5d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.538695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27245f79-5a89-4c7f-b908-e941ea4cf5d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:51.539280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27245f79-5a89-4c7f-b908-e941ea4cf5d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:51.540262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:51.548669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a587eac1-662f-40f7-9823-d87946b26d34 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.169108 Jun 17 12:56:51.549217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 338/715] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:51 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:51.571636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-27245f79-5a89-4c7f-b908-e941ea4cf5d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045479 Jun 17 12:56:51.572316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 378/716] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:52.317933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fba5c4eb-be98-4e2f-8950-15fbfd50205d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:52.319506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fba5c4eb-be98-4e2f-8950-15fbfd50205d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:52.330496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fba5c4eb-be98-4e2f-8950-15fbfd50205d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.331230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fba5c4eb-be98-4e2f-8950-15fbfd50205d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.332528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fba5c4eb-be98-4e2f-8950-15fbfd50205d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.333244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fba5c4eb-be98-4e2f-8950-15fbfd50205d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.362696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:52.363258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:52.365487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fba5c4eb-be98-4e2f-8950-15fbfd50205d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054259 Jun 17 12:56:52.366051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 339/717] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:52.370710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.371079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.371882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.372306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.511116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:52.519268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d984da34-825b-49c9-abd9-8764b2ab4f51 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.161000 Jun 17 12:56:52.519873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 379/718] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:52.566003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:52.566610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:52.572944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.573437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.574200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.574633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.583405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f1a8e1c-18b7-4c55-b4d3-1d8e337c0859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:52.584302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f1a8e1c-18b7-4c55-b4d3-1d8e337c0859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:52.591133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f1a8e1c-18b7-4c55-b4d3-1d8e337c0859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.591607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f1a8e1c-18b7-4c55-b4d3-1d8e337c0859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.592372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f1a8e1c-18b7-4c55-b4d3-1d8e337c0859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:52.592759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f1a8e1c-18b7-4c55-b4d3-1d8e337c0859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:52.619672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:52.625212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f1a8e1c-18b7-4c55-b4d3-1d8e337c0859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045692 Jun 17 12:56:52.625704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 380/719] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:52.704541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:52.716598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-66fe1ef6-2bd6-4050-9c02-3450afe7b01e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.154099 Jun 17 12:56:52.717365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 340/720] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:53.377476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dd9d3bc8-b61f-4e24-b059-9e98d1dbd116 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:53.378423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dd9d3bc8-b61f-4e24-b059-9e98d1dbd116 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:53.388206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9d3bc8-b61f-4e24-b059-9e98d1dbd116 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.388653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9d3bc8-b61f-4e24-b059-9e98d1dbd116 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.389419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9d3bc8-b61f-4e24-b059-9e98d1dbd116 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.389849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd9d3bc8-b61f-4e24-b059-9e98d1dbd116 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.421816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dd9d3bc8-b61f-4e24-b059-9e98d1dbd116 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048536 Jun 17 12:56:53.422377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 381/721] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:53.542141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:53.543187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:53.554352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.554808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.555626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.556058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.637438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76407448-2e2f-4396-b808-bfe627f2944d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:53.638425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76407448-2e2f-4396-b808-bfe627f2944d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:53.644977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76407448-2e2f-4396-b808-bfe627f2944d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.645526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76407448-2e2f-4396-b808-bfe627f2944d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.646355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76407448-2e2f-4396-b808-bfe627f2944d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.646856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76407448-2e2f-4396-b808-bfe627f2944d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.686807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76407448-2e2f-4396-b808-bfe627f2944d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053507 Jun 17 12:56:53.687398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 382/722] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:53.694795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:53.702841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f0dda4dd-0afa-43ae-aca0-f3a8959952db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168062 Jun 17 12:56:53.703398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 341/723] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:53.737654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:53.738259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:53.744758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.745198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.745964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:53.746400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:53.884434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:53.892749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-87bca74e-425f-4fe3-bfe6-875f1bbee5aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.159335 Jun 17 12:56:53.893295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 383/724] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:54.439012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-54235511-ad26-4dca-8409-0429bfcd3359 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:54.440416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-54235511-ad26-4dca-8409-0429bfcd3359 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:54.450753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54235511-ad26-4dca-8409-0429bfcd3359 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.451540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54235511-ad26-4dca-8409-0429bfcd3359 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.452789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54235511-ad26-4dca-8409-0429bfcd3359 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.453497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54235511-ad26-4dca-8409-0429bfcd3359 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.485712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-54235511-ad26-4dca-8409-0429bfcd3359 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053434 Jun 17 12:56:54.486258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 342/725] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:54.703479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81a8eb61-6e46-4eea-bf2b-917eb33f9ca5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:54.705233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81a8eb61-6e46-4eea-bf2b-917eb33f9ca5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:54.716793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a8eb61-6e46-4eea-bf2b-917eb33f9ca5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.717569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a8eb61-6e46-4eea-bf2b-917eb33f9ca5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.718844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a8eb61-6e46-4eea-bf2b-917eb33f9ca5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.719909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81a8eb61-6e46-4eea-bf2b-917eb33f9ca5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.725223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:54.726349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:54.733815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.734262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.735405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.735873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.753743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81a8eb61-6e46-4eea-bf2b-917eb33f9ca5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057031 Jun 17 12:56:54.754314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 384/726] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:54.875889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:54.884163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-84725cdf-c5ec-482b-af75-f470a0bf0b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165649 Jun 17 12:56:54.884728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 343/727] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:54.917295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:54.917921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:54.924647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.925099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.925855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:54.926283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:54.956484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:56:54.956876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 12:56:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 (ip 10.222.0.87) !!! Jun 17 12:56:55.061331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:55.069551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e9ef77b5-bad8-42b2-ae8f-8f0cc73e1d38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.156528 Jun 17 12:56:55.070746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 385/728] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:55.501236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9031c2ea-1b9b-48be-8f8d-03fb96febeb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:55.502065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9031c2ea-1b9b-48be-8f8d-03fb96febeb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:55.512359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9031c2ea-1b9b-48be-8f8d-03fb96febeb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:55.512927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9031c2ea-1b9b-48be-8f8d-03fb96febeb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:55.513702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9031c2ea-1b9b-48be-8f8d-03fb96febeb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:55.514123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9031c2ea-1b9b-48be-8f8d-03fb96febeb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:55.544679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9031c2ea-1b9b-48be-8f8d-03fb96febeb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 Jun 17 12:56:55.545227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 344/729] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:55.767038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ce70e9a7-eeae-4cbe-9f4f-1f24d40ff1f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:55.768506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ce70e9a7-eeae-4cbe-9f4f-1f24d40ff1f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:55.779176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce70e9a7-eeae-4cbe-9f4f-1f24d40ff1f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:55.779920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce70e9a7-eeae-4cbe-9f4f-1f24d40ff1f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:55.781161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce70e9a7-eeae-4cbe-9f4f-1f24d40ff1f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:55.781864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce70e9a7-eeae-4cbe-9f4f-1f24d40ff1f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:55.820360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ce70e9a7-eeae-4cbe-9f4f-1f24d40ff1f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057881 Jun 17 12:56:55.820859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 386/730] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:55.902979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:55.903818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:55.910621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:55.911062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:55.911861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:55.912294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:56.055991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:56.064379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ee67f79f-fdd7-4261-b769-24be3bab05c9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165408 Jun 17 12:56:56.064837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 345/731] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:56.086970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:56.087600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:56.093950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:56.094396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:56.095153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:56.095641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:56.241380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:56.255237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aa80b90b-a686-44b5-8de4-3446ba093a49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.172086 Jun 17 12:56:56.255966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 387/732] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:56.556881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-290428dd-90f0-4cb4-871d-2e9aaabb9fa7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:56.557730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-290428dd-90f0-4cb4-871d-2e9aaabb9fa7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:56.564385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290428dd-90f0-4cb4-871d-2e9aaabb9fa7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:56.564826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290428dd-90f0-4cb4-871d-2e9aaabb9fa7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:56.565586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290428dd-90f0-4cb4-871d-2e9aaabb9fa7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:56.566011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290428dd-90f0-4cb4-871d-2e9aaabb9fa7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:56.598013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-290428dd-90f0-4cb4-871d-2e9aaabb9fa7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Jun 17 12:56:56.598590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 346/733] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:56.836804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-06c7a281-74ad-4dc1-aee9-1e5b5b595963 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:56.838419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-06c7a281-74ad-4dc1-aee9-1e5b5b595963 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:56.849571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06c7a281-74ad-4dc1-aee9-1e5b5b595963 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:56.850288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06c7a281-74ad-4dc1-aee9-1e5b5b595963 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:56.851128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06c7a281-74ad-4dc1-aee9-1e5b5b595963 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:56.851592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06c7a281-74ad-4dc1-aee9-1e5b5b595963 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:56.887914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-06c7a281-74ad-4dc1-aee9-1e5b5b595963 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058077 Jun 17 12:56:56.888464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 388/734] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:57.084221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:57.084830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:57.104602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.104976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.105756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.106178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.245552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:57.253501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d606839c-e829-4847-adb4-784dbf7c83c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175063 Jun 17 12:56:57.254075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 347/735] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:57.275652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:57.276274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:57.282606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.283016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.283805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.284228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.415408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:57.424216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-19e37659-4492-40db-bff1-11b8d58c9688 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.154324 Jun 17 12:56:57.424770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 389/736] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:57.614180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f7096eca-bb27-4986-9c39-915d93c190d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:57.615587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f7096eca-bb27-4986-9c39-915d93c190d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:57.626808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7096eca-bb27-4986-9c39-915d93c190d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.627597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7096eca-bb27-4986-9c39-915d93c190d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.628833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7096eca-bb27-4986-9c39-915d93c190d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.629545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7096eca-bb27-4986-9c39-915d93c190d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.663882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f7096eca-bb27-4986-9c39-915d93c190d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056880 Jun 17 12:56:57.664420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 348/737] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:57.901626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-19e954f5-00fc-4118-a794-ef8d0e8ab1cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:57.902571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-19e954f5-00fc-4118-a794-ef8d0e8ab1cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:57.909582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e954f5-00fc-4118-a794-ef8d0e8ab1cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.909961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e954f5-00fc-4118-a794-ef8d0e8ab1cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.910732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e954f5-00fc-4118-a794-ef8d0e8ab1cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:57.911160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e954f5-00fc-4118-a794-ef8d0e8ab1cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:57.940969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-19e954f5-00fc-4118-a794-ef8d0e8ab1cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043275 Jun 17 12:56:57.941539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 390/738] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:58.270600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:58.271294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:58.278736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.279199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.279978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.280401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.442657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:58.443412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:58.444090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:58.450673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.451117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.451906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.452333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.455509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0755cd0e-1812-4e29-a136-0d413345b3f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.188677 Jun 17 12:56:58.457965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 349/739] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:58.583747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:58.592532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d1f8f1b2-9765-4dd8-a30d-83c92ed7ab80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.154338 Jun 17 12:56:58.593093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 391/740] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:58.680423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4be3709d-23ce-4d7e-89a9-977359a340e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:58.681960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4be3709d-23ce-4d7e-89a9-977359a340e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:58.692408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be3709d-23ce-4d7e-89a9-977359a340e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.693034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be3709d-23ce-4d7e-89a9-977359a340e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.694321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be3709d-23ce-4d7e-89a9-977359a340e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.695032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be3709d-23ce-4d7e-89a9-977359a340e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.725288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4be3709d-23ce-4d7e-89a9-977359a340e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051562 Jun 17 12:56:58.725834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 350/741] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:56:58.957661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-601a200e-1b45-4aba-a6d9-5d737efc2478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:58.959205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-601a200e-1b45-4aba-a6d9-5d737efc2478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:58.967873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601a200e-1b45-4aba-a6d9-5d737efc2478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.968343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601a200e-1b45-4aba-a6d9-5d737efc2478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.969115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601a200e-1b45-4aba-a6d9-5d737efc2478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:58.969533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601a200e-1b45-4aba-a6d9-5d737efc2478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:58.999637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-601a200e-1b45-4aba-a6d9-5d737efc2478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048812 Jun 17 12:56:59.000173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 392/742] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:56:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:56:59.476116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:59.477044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:59.488184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:59.488778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:59.489942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:59.490613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:59.610822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:59.611427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:59.617935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:59.618387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:59.619246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:59.619720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:59.628978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:59.636658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7c2405b3-55e8-4adb-9048-5cab3c9dd62c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166546 Jun 17 12:56:59.637198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 351/743] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:59 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:59.737224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e713e31f-6b0b-4324-9c3c-78ce40c9fc92 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:56:59.738295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e713e31f-6b0b-4324-9c3c-78ce40c9fc92 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:56:59.745093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e713e31f-6b0b-4324-9c3c-78ce40c9fc92 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:59.745533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e713e31f-6b0b-4324-9c3c-78ce40c9fc92 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:59.746298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e713e31f-6b0b-4324-9c3c-78ce40c9fc92 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:59.746781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e713e31f-6b0b-4324-9c3c-78ce40c9fc92 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:59.762232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:56:59.770375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-16df16e6-b9b0-408a-b8c9-88258ead6857 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.163812 Jun 17 12:56:59.770945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 393/744] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:56:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:56:59.776979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e713e31f-6b0b-4324-9c3c-78ce40c9fc92 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Jun 17 12:56:59.777534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 352/745] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:56:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:00.013155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dda81b94-88d7-4af0-8e9e-7127a25a3ffe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:00.014071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dda81b94-88d7-4af0-8e9e-7127a25a3ffe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:00.021214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dda81b94-88d7-4af0-8e9e-7127a25a3ffe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.021734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dda81b94-88d7-4af0-8e9e-7127a25a3ffe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.022602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dda81b94-88d7-4af0-8e9e-7127a25a3ffe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.023055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dda81b94-88d7-4af0-8e9e-7127a25a3ffe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.053437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dda81b94-88d7-4af0-8e9e-7127a25a3ffe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045104 Jun 17 12:57:00.057806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 394/746] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:00.657662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:00.658448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:00.668241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.668684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.669470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.669899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.788784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:00.789410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:00.796080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.796801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.797571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.798004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.803827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:00.811856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a0e3dcd1-cc1e-410f-b440-14ecb04924f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160372 Jun 17 12:57:00.812440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 353/747] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:00.818776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8fa45cbf-23f6-4a86-a908-3c0fcd68929c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:00.820165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8fa45cbf-23f6-4a86-a908-3c0fcd68929c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:00.826725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fa45cbf-23f6-4a86-a908-3c0fcd68929c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.827255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fa45cbf-23f6-4a86-a908-3c0fcd68929c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.828122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fa45cbf-23f6-4a86-a908-3c0fcd68929c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:00.828625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fa45cbf-23f6-4a86-a908-3c0fcd68929c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:00.854167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:00.859256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8fa45cbf-23f6-4a86-a908-3c0fcd68929c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045848 Jun 17 12:57:00.860251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 354/748] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:00.932581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:00.941404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-04911052-6233-400d-b896-de376cd9d0bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.156569 Jun 17 12:57:00.942034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 395/749] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:01.070820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bb38ad22-6b1c-4b6b-b844-17e6770b6c12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:01.072200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bb38ad22-6b1c-4b6b-b844-17e6770b6c12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:01.082869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb38ad22-6b1c-4b6b-b844-17e6770b6c12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.083780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb38ad22-6b1c-4b6b-b844-17e6770b6c12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.085027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb38ad22-6b1c-4b6b-b844-17e6770b6c12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.085738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb38ad22-6b1c-4b6b-b844-17e6770b6c12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.116608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bb38ad22-6b1c-4b6b-b844-17e6770b6c12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053030 Jun 17 12:57:01.116869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 355/750] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:01.833690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:01.834656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:01.843561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.844009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.844765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.845192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.871809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e445d2ff-239b-43cb-90af-8f5d787e7f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:01.872732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e445d2ff-239b-43cb-90af-8f5d787e7f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:01.879743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e445d2ff-239b-43cb-90af-8f5d787e7f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.880192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e445d2ff-239b-43cb-90af-8f5d787e7f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.880959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e445d2ff-239b-43cb-90af-8f5d787e7f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.881388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e445d2ff-239b-43cb-90af-8f5d787e7f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.911230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e445d2ff-239b-43cb-90af-8f5d787e7f45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Jun 17 12:57:01.911835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 356/751] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:01.964371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:01.965034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:01.971279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.971755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.972518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:01.972943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:01.981423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:01.989450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-20118851-c27a-434f-870a-e6f29497ac33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162431 Jun 17 12:57:01.989992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 396/752] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:02.128521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4410490a-f72d-4218-b6a9-470d84aa9f5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:02.129441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4410490a-f72d-4218-b6a9-470d84aa9f5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:02.136810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4410490a-f72d-4218-b6a9-470d84aa9f5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:02.137276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4410490a-f72d-4218-b6a9-470d84aa9f5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:02.138050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4410490a-f72d-4218-b6a9-470d84aa9f5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:02.138494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4410490a-f72d-4218-b6a9-470d84aa9f5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:02.156549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.171704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4410490a-f72d-4218-b6a9-470d84aa9f5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047066 Jun 17 12:57:02.172284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 397/753] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:02.338693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:02.349622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ef894020-ba9d-4ff6-98b9-00f30ee108e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.388996 Jun 17 12:57:02.350335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 357/754] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:02.927080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-44bf7616-2bf4-49f7-bf75-1ce756e57728 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:02.928042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-44bf7616-2bf4-49f7-bf75-1ce756e57728 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:02.938429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44bf7616-2bf4-49f7-bf75-1ce756e57728 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:02.939039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44bf7616-2bf4-49f7-bf75-1ce756e57728 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:02.940217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44bf7616-2bf4-49f7-bf75-1ce756e57728 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:02.940655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44bf7616-2bf4-49f7-bf75-1ce756e57728 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:02.974534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-44bf7616-2bf4-49f7-bf75-1ce756e57728 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053818 Jun 17 12:57:02.975101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 398/755] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:03.006151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.006745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:03.014043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.014485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.015249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.015712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.153619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:03.161264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fe9b1c41-9b9a-4708-bb70-05381df6b4c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158989 Jun 17 12:57:03.161823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 358/756] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:03.182821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6c0fe2ae-e69e-4633-b9aa-173817f49577 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.183743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6c0fe2ae-e69e-4633-b9aa-173817f49577 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:03.190029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c0fe2ae-e69e-4633-b9aa-173817f49577 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.190464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c0fe2ae-e69e-4633-b9aa-173817f49577 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.191210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c0fe2ae-e69e-4633-b9aa-173817f49577 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.191666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c0fe2ae-e69e-4633-b9aa-173817f49577 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.221612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6c0fe2ae-e69e-4633-b9aa-173817f49577 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042797 Jun 17 12:57:03.222167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 399/757] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:57:03.372134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.372799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:03.379661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.380125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.380924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.381376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.515566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:03.524050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b8b9b963-5c51-41f2-8326-cc8261bb1ecb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1716 microversion: 2.1 time: 0.158210 Jun 17 12:57:03.524605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 359/758] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:03.581995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.582484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:03.589336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.590062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.590951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:03.591349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:03.991167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f2cf57b2-643d-4d1c-b231-12b4c100f7b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.992623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f2cf57b2-643d-4d1c-b231-12b4c100f7b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:04.000678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2cf57b2-643d-4d1c-b231-12b4c100f7b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:04.001114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2cf57b2-643d-4d1c-b231-12b4c100f7b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:04.001858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2cf57b2-643d-4d1c-b231-12b4c100f7b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:04.002282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2cf57b2-643d-4d1c-b231-12b4c100f7b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:04.032075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f2cf57b2-643d-4d1c-b231-12b4c100f7b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047873 Jun 17 12:57:04.032730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 360/759] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:04.181771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:04.182693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:04.189633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:04.190082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:04.190840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:04.191281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:04.337035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:04.349331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ddf64684-0ee0-467e-ab2a-32d4be68cc14 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173294 Jun 17 12:57:04.350183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 361/760] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:04.354800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4f6c5484-dc1b-42af-87e8-aaca44fa29fd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:04.355799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4f6c5484-dc1b-42af-87e8-aaca44fa29fd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:04.362057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f6c5484-dc1b-42af-87e8-aaca44fa29fd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:04.362498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f6c5484-dc1b-42af-87e8-aaca44fa29fd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:04.363255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f6c5484-dc1b-42af-87e8-aaca44fa29fd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:04.363722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f6c5484-dc1b-42af-87e8-aaca44fa29fd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:04.392719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4f6c5484-dc1b-42af-87e8-aaca44fa29fd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041527 Jun 17 12:57:04.393262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 362/761] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:04.684568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-4a179f36-405a-4e44-b9dc-0501e21bb427 req-ed6cdd82-5769-462a-9f51-bb3446dd7f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e78628d-5386-4d24-adb0-9ea06bce2e6f", "name": "network-vif-unplugged", "status": "completed", "tag": "f207d69b-630e-4aae-8a6c-17febe0a96eb"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:04.693202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-4a179f36-405a-4e44-b9dc-0501e21bb427 req-ed6cdd82-5769-462a-9f51-bb3446dd7f0d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:04.693640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-4a179f36-405a-4e44-b9dc-0501e21bb427 req-ed6cdd82-5769-462a-9f51-bb3446dd7f0d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:04.705249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-4a179f36-405a-4e44-b9dc-0501e21bb427 req-ed6cdd82-5769-462a-9f51-bb3446dd7f0d service nova] Creating event network-vif-unplugged:f207d69b-630e-4aae-8a6c-17febe0a96eb for instance 7e78628d-5386-4d24-adb0-9ea06bce2e6f on hv-cinder-84617 Jun 17 12:57:04.710361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-4a179f36-405a-4e44-b9dc-0501e21bb427 req-ed6cdd82-5769-462a-9f51-bb3446dd7f0d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029540 Jun 17 12:57:04.710954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 363/762] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:05.047320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc0700c7-9bb1-479c-bdae-59e15263c8fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:05.048406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc0700c7-9bb1-479c-bdae-59e15263c8fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:05.055485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc0700c7-9bb1-479c-bdae-59e15263c8fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:05.055942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc0700c7-9bb1-479c-bdae-59e15263c8fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:05.056740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc0700c7-9bb1-479c-bdae-59e15263c8fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:05.057199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc0700c7-9bb1-479c-bdae-59e15263c8fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:05.088092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc0700c7-9bb1-479c-bdae-59e15263c8fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046579 Jun 17 12:57:05.088651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 364/763] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:05.371586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:05.372433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:05.382480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:05.383213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:05.384512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:05.385233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:05.529728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:05.537745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eeb78836-38c2-4181-9a4a-9b3e2506e906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173079 Jun 17 12:57:05.538302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 365/764] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:05.542842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8f09dda2-6fb8-4983-b0ca-f7adb75c7456 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:05.543976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8f09dda2-6fb8-4983-b0ca-f7adb75c7456 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:05.549708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f09dda2-6fb8-4983-b0ca-f7adb75c7456 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:05.550156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f09dda2-6fb8-4983-b0ca-f7adb75c7456 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:05.550908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f09dda2-6fb8-4983-b0ca-f7adb75c7456 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:05.551340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f09dda2-6fb8-4983-b0ca-f7adb75c7456 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:05.580841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8f09dda2-6fb8-4983-b0ca-f7adb75c7456 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041530 Jun 17 12:57:05.581378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 366/765] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:06.104393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad2f0028-6d73-4642-a0cf-f773d89f66d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:06.106052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad2f0028-6d73-4642-a0cf-f773d89f66d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:06.113540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2f0028-6d73-4642-a0cf-f773d89f66d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:06.113989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2f0028-6d73-4642-a0cf-f773d89f66d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:06.114761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2f0028-6d73-4642-a0cf-f773d89f66d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:06.115161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2f0028-6d73-4642-a0cf-f773d89f66d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:06.145587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad2f0028-6d73-4642-a0cf-f773d89f66d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047782 Jun 17 12:57:06.146135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 367/766] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:06.556396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:06.557154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:06.565256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:06.565815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:06.566764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:06.567301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:06.701677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:06.709940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-98311870-153a-4ef4-a206-78d079e26dfb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158546 Jun 17 12:57:06.710471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 368/767] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:06.714953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-292df23f-10e7-47dc-8f6a-b96a3d0e1eb2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:06.715894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-292df23f-10e7-47dc-8f6a-b96a3d0e1eb2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:06.721698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-292df23f-10e7-47dc-8f6a-b96a3d0e1eb2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:06.722143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-292df23f-10e7-47dc-8f6a-b96a3d0e1eb2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:06.722939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-292df23f-10e7-47dc-8f6a-b96a3d0e1eb2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:06.723421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-292df23f-10e7-47dc-8f6a-b96a3d0e1eb2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:06.753484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-292df23f-10e7-47dc-8f6a-b96a3d0e1eb2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042008 Jun 17 12:57:06.754027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 369/768] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:07.159089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8f067268-e5ba-4873-b76a-2db2f9663b0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:07.160575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8f067268-e5ba-4873-b76a-2db2f9663b0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:07.170554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f067268-e5ba-4873-b76a-2db2f9663b0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:07.171274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f067268-e5ba-4873-b76a-2db2f9663b0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:07.172462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f067268-e5ba-4873-b76a-2db2f9663b0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:07.173128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f067268-e5ba-4873-b76a-2db2f9663b0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:07.206546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8f067268-e5ba-4873-b76a-2db2f9663b0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053638 Jun 17 12:57:07.207096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 370/769] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:07.730979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:07.731907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:07.739212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:07.739688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:07.740456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:07.740892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:07.878291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:07.886295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a4356bc-7d0f-4b28-836c-cea7f11b6ec8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.161710 Jun 17 12:57:07.886902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 371/770] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:07.891576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-43b27ff7-6625-472e-a627-ab72fc0b55e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:07.892488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-43b27ff7-6625-472e-a627-ab72fc0b55e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:07.898609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43b27ff7-6625-472e-a627-ab72fc0b55e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:07.899057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43b27ff7-6625-472e-a627-ab72fc0b55e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:07.899859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43b27ff7-6625-472e-a627-ab72fc0b55e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:07.900291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43b27ff7-6625-472e-a627-ab72fc0b55e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:07.904088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:07.929753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-43b27ff7-6625-472e-a627-ab72fc0b55e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041812 Jun 17 12:57:07.930301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 372/771] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:08.220089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-670cdbf3-46ba-45ad-88ed-2ce1f12693da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:08.221016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-670cdbf3-46ba-45ad-88ed-2ce1f12693da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:08.227638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-670cdbf3-46ba-45ad-88ed-2ce1f12693da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:08.228089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-670cdbf3-46ba-45ad-88ed-2ce1f12693da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:08.228853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-670cdbf3-46ba-45ad-88ed-2ce1f12693da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:08.229299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-670cdbf3-46ba-45ad-88ed-2ce1f12693da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:08.260068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-670cdbf3-46ba-45ad-88ed-2ce1f12693da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045270 Jun 17 12:57:08.260627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 373/772] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:08.908420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:08.909416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:08.920230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:08.920679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:08.921477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:08.921918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:09.080616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:09.088650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4fe7cbc8-4fbc-45fa-892a-e7c43cbd0dce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.187315 Jun 17 12:57:09.089224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 374/773] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:09.093796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-35b0027f-d03e-4ff8-bace-bfb3530ab667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.094706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-35b0027f-d03e-4ff8-bace-bfb3530ab667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:09.100874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35b0027f-d03e-4ff8-bace-bfb3530ab667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:09.101320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35b0027f-d03e-4ff8-bace-bfb3530ab667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:09.102083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35b0027f-d03e-4ff8-bace-bfb3530ab667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:09.102514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35b0027f-d03e-4ff8-bace-bfb3530ab667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:09.141220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-35b0027f-d03e-4ff8-bace-bfb3530ab667 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050915 Jun 17 12:57:09.141752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 375/774] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:09.276107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47272fa1-e0e5-42c7-8a78-3ed68621af84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.277578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47272fa1-e0e5-42c7-8a78-3ed68621af84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:09.279744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:09.284870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47272fa1-e0e5-42c7-8a78-3ed68621af84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:09.285388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47272fa1-e0e5-42c7-8a78-3ed68621af84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:09.286355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47272fa1-e0e5-42c7-8a78-3ed68621af84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:09.286824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47272fa1-e0e5-42c7-8a78-3ed68621af84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:09.318029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47272fa1-e0e5-42c7-8a78-3ed68621af84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048261 Jun 17 12:57:09.318616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 376/775] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:09.993793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.994474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:10.002302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.002748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.003552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.003982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.029465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 12:57:10.121574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cf484f39-2afa-4a77-8074-64e4ec52bab5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "DELETE /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 204 len: 0 microversion: 2.1 time: 0.133951 Jun 17 12:57:10.122170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 377/776] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 12:57:09 2022] DELETE /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:57:10.128091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:10.128878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:10.134830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.135271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.136062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.136485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.273166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:10.281397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34257f16-df37-4f54-82e4-1469007e549b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158102 Jun 17 12:57:10.281952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 378/777] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:10 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:10.286367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:10.286939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:10.292819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.293266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.294032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.294467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.436856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:10.444758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b91d71b0-c912-4352-8070-3010231536bf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1578 microversion: 2.1 time: 0.161806 Jun 17 12:57:10.445346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 379/778] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:10 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:10.450664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e4224be9-2daf-4d83-8394-dcc23f2680b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:10.451684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e4224be9-2daf-4d83-8394-dcc23f2680b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:10.458159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4224be9-2daf-4d83-8394-dcc23f2680b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.458602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4224be9-2daf-4d83-8394-dcc23f2680b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.459359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4224be9-2daf-4d83-8394-dcc23f2680b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.459807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4224be9-2daf-4d83-8394-dcc23f2680b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.489503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e4224be9-2daf-4d83-8394-dcc23f2680b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043099 Jun 17 12:57:10.490025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 380/779] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:10.494468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fb4a5e88-c885-420d-983c-da7538ea41c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:10.495399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fb4a5e88-c885-420d-983c-da7538ea41c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:10.501261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb4a5e88-c885-420d-983c-da7538ea41c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.501708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb4a5e88-c885-420d-983c-da7538ea41c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.502458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb4a5e88-c885-420d-983c-da7538ea41c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:10.502885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb4a5e88-c885-420d-983c-da7538ea41c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:10.532413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fb4a5e88-c885-420d-983c-da7538ea41c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041284 Jun 17 12:57:10.532890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 381/780] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:11.303080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:11.304158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:11.316300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.317034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.318294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.318995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.467364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:11.475842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-11b00301-e7f4-4ffc-aff9-a530e0f85bf4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.179695 Jun 17 12:57:11.476406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 382/781] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:11.481011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:11.481609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:11.488268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.488750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.489538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.489968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.693709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:11.701637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d063c66e-2914-43c4-b7a5-530a367ab823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1578 microversion: 2.1 time: 0.224257 Jun 17 12:57:11.702211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 383/782] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:11 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1578 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:11.706867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-83eee931-33cb-42b7-b625-06bdc91394cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:11.707811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-83eee931-33cb-42b7-b625-06bdc91394cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:11.714042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83eee931-33cb-42b7-b625-06bdc91394cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.714505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83eee931-33cb-42b7-b625-06bdc91394cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.715263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83eee931-33cb-42b7-b625-06bdc91394cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.715731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83eee931-33cb-42b7-b625-06bdc91394cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.746024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-83eee931-33cb-42b7-b625-06bdc91394cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042790 Jun 17 12:57:11.746616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 384/783] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:11.751283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-36a4a42f-50c5-4858-b7c3-e4172efe3460 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:11.752245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-36a4a42f-50c5-4858-b7c3-e4172efe3460 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:11.758286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a4a42f-50c5-4858-b7c3-e4172efe3460 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.758730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a4a42f-50c5-4858-b7c3-e4172efe3460 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.759530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a4a42f-50c5-4858-b7c3-e4172efe3460 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:11.759954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a4a42f-50c5-4858-b7c3-e4172efe3460 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:11.789065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-36a4a42f-50c5-4858-b7c3-e4172efe3460 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 Jun 17 12:57:11.789622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 385/784] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:12.536230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-fa9905f6-29dd-4843-b5cc-91b3b6762dea req-335e98a7-d16e-432a-819c-07fb24b79776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556e3927-0db8-47b5-a3f0-f0338fd92dee", "name": "network-vif-deleted", "tag": "70865a20-dd41-4701-9d32-dd973d8fd09d"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:12.545332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-fa9905f6-29dd-4843-b5cc-91b3b6762dea req-335e98a7-d16e-432a-819c-07fb24b79776 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.545771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-fa9905f6-29dd-4843-b5cc-91b3b6762dea req-335e98a7-d16e-432a-819c-07fb24b79776 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.557772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-fa9905f6-29dd-4843-b5cc-91b3b6762dea req-335e98a7-d16e-432a-819c-07fb24b79776 service nova] Creating event network-vif-deleted:70865a20-dd41-4701-9d32-dd973d8fd09d for instance 556e3927-0db8-47b5-a3f0-f0338fd92dee on hv-cinder-84617 Jun 17 12:57:12.562638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-fa9905f6-29dd-4843-b5cc-91b3b6762dea req-335e98a7-d16e-432a-819c-07fb24b79776 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099197 Jun 17 12:57:12.563234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 386/785] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:57:12.568466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:12.569163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:12.575697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.576149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.576924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.577367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.714779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:12.718476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:12.723786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ba92b7dd-9561-4afe-8cfc-4862f1c842c5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.159181 Jun 17 12:57:12.724377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 387/786] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:12.732906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:12.733737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:12.741707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.742155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.742959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.743407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.807223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:12.815230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c6fed2aa-d9a6-4d77-a8f5-d15f236496a9 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089822 Jun 17 12:57:12.816015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 388/787] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:12 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:12.820564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f44583dc-5213-41ff-a572-6437c1dd0b40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:12.821483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f44583dc-5213-41ff-a572-6437c1dd0b40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:12.827280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f44583dc-5213-41ff-a572-6437c1dd0b40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.827900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f44583dc-5213-41ff-a572-6437c1dd0b40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.828676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f44583dc-5213-41ff-a572-6437c1dd0b40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.829142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f44583dc-5213-41ff-a572-6437c1dd0b40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.858574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f44583dc-5213-41ff-a572-6437c1dd0b40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041757 Jun 17 12:57:12.859276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 389/788] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:12.864302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eda11a29-10af-47dc-b3c4-8d7700c037e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:12.865187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eda11a29-10af-47dc-b3c4-8d7700c037e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:12.870987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eda11a29-10af-47dc-b3c4-8d7700c037e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.871456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eda11a29-10af-47dc-b3c4-8d7700c037e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.872219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eda11a29-10af-47dc-b3c4-8d7700c037e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:12.872655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eda11a29-10af-47dc-b3c4-8d7700c037e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:12.902820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eda11a29-10af-47dc-b3c4-8d7700c037e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Jun 17 12:57:12.903413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 390/789] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:13.586251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=75 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:13.610376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=18 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:13.743795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:13.744673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:13.753571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:13.754008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:13.754772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:13.755200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:13.897472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:13.908263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a7cb4f8-d5c0-476e-b170-c16a7259c4ef tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168755 Jun 17 12:57:13.909087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 391/790] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:13.913605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:13.914194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:13.920250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:13.920694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:13.921464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:13.922149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:13.986460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:13.994092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7d4c9311-d885-4e3e-8576-e6756d8b1e7f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083956 Jun 17 12:57:13.994622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 392/791] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:13 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:13.999184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5094923-4fb1-49cb-8636-73473443cda5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:14.000168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5094923-4fb1-49cb-8636-73473443cda5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:14.006096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5094923-4fb1-49cb-8636-73473443cda5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:14.006578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5094923-4fb1-49cb-8636-73473443cda5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:14.007347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5094923-4fb1-49cb-8636-73473443cda5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:14.007806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5094923-4fb1-49cb-8636-73473443cda5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:14.039019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5094923-4fb1-49cb-8636-73473443cda5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043389 Jun 17 12:57:14.039601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 393/792] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:14.044093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0ab2c25e-8c78-4c91-b5c6-2566b29c8771 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:14.044992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0ab2c25e-8c78-4c91-b5c6-2566b29c8771 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:14.051440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ab2c25e-8c78-4c91-b5c6-2566b29c8771 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:14.051907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ab2c25e-8c78-4c91-b5c6-2566b29c8771 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:14.052662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ab2c25e-8c78-4c91-b5c6-2566b29c8771 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:14.053093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ab2c25e-8c78-4c91-b5c6-2566b29c8771 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:14.088218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0ab2c25e-8c78-4c91-b5c6-2566b29c8771 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047529 Jun 17 12:57:14.088772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 394/793] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:14.929006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:14.930062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:14.941198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:14.941887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:14.943145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:14.944080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:15.086740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:15.095270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5ceeecc1-b2b9-4ac3-a8ec-0bfde02381c8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172819 Jun 17 12:57:15.095844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 395/794] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:15.100211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:15.100843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:15.107132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:15.107615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:15.108372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:15.108806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:15.176499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:15.184831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8e02e465-8069-4020-aa07-92da154cf572 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087919 Jun 17 12:57:15.185303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 396/795] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:15 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:15.190061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-50991705-234b-4457-a8aa-7eb32b8192b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:15.190968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-50991705-234b-4457-a8aa-7eb32b8192b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:15.197043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50991705-234b-4457-a8aa-7eb32b8192b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:15.197486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50991705-234b-4457-a8aa-7eb32b8192b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:15.198249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50991705-234b-4457-a8aa-7eb32b8192b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:15.198676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50991705-234b-4457-a8aa-7eb32b8192b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:15.228365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-50991705-234b-4457-a8aa-7eb32b8192b3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042063 Jun 17 12:57:15.228910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 397/796] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:15.233321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b46e042d-2282-4a1f-92b8-75483b7623c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:15.234216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b46e042d-2282-4a1f-92b8-75483b7623c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:15.240775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b46e042d-2282-4a1f-92b8-75483b7623c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:15.241223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b46e042d-2282-4a1f-92b8-75483b7623c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:15.241986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b46e042d-2282-4a1f-92b8-75483b7623c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:15.242447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b46e042d-2282-4a1f-92b8-75483b7623c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:15.271916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b46e042d-2282-4a1f-92b8-75483b7623c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Jun 17 12:57:15.272512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 398/797] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:16.117922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:16.118938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:16.128802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.129254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.130015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.130442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.269148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:16.277353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ee896297-f378-41d3-87be-b2748c8ab8f2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167212 Jun 17 12:57:16.277910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 399/798] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:16.282557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:16.283166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:16.289207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.289652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.290447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.290877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.353097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:16.361187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02ca9b6d-a9d7-4c9b-adff-2c1ad593a7ef tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081954 Jun 17 12:57:16.361886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 400/799] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:16 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:16.366456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dedf5ce3-8c62-4667-8f0e-b18bb664bcbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:16.367389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dedf5ce3-8c62-4667-8f0e-b18bb664bcbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:16.373575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dedf5ce3-8c62-4667-8f0e-b18bb664bcbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.373966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dedf5ce3-8c62-4667-8f0e-b18bb664bcbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.374727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dedf5ce3-8c62-4667-8f0e-b18bb664bcbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.375152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dedf5ce3-8c62-4667-8f0e-b18bb664bcbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.405939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dedf5ce3-8c62-4667-8f0e-b18bb664bcbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043011 Jun 17 12:57:16.406502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 401/800] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:16.411059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-58b88d20-22d8-4b2e-ab46-ca1734278a82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:16.411958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-58b88d20-22d8-4b2e-ab46-ca1734278a82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:16.417683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58b88d20-22d8-4b2e-ab46-ca1734278a82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.418124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58b88d20-22d8-4b2e-ab46-ca1734278a82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.418887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58b88d20-22d8-4b2e-ab46-ca1734278a82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:16.419304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58b88d20-22d8-4b2e-ab46-ca1734278a82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:16.448265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-58b88d20-22d8-4b2e-ab46-ca1734278a82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Jun 17 12:57:16.448825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 402/801] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:17.294988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:17.295853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:17.303061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.303537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.304302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.304737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.441239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:17.449198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-10fa3ba8-41ae-47e3-aa8e-a7da60373914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158369 Jun 17 12:57:17.449759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 403/802] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:17.455216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:17.455832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:17.462018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.462466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.463224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.463698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.481959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:17.531259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:17.539995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b39fa647-10ac-4f30-839d-97226532999f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089289 Jun 17 12:57:17.540538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 404/803] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:17 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:17.545246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ef4e8581-1e3e-482e-96db-c00b151f7190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:17.546156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ef4e8581-1e3e-482e-96db-c00b151f7190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:17.552176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef4e8581-1e3e-482e-96db-c00b151f7190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.552618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef4e8581-1e3e-482e-96db-c00b151f7190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.553413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef4e8581-1e3e-482e-96db-c00b151f7190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.553845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef4e8581-1e3e-482e-96db-c00b151f7190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.583315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ef4e8581-1e3e-482e-96db-c00b151f7190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041760 Jun 17 12:57:17.583896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 405/804] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:17.588308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a22d104f-df72-4fe8-bff1-c65a139af6fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:17.589195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a22d104f-df72-4fe8-bff1-c65a139af6fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:17.594969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a22d104f-df72-4fe8-bff1-c65a139af6fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.595391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a22d104f-df72-4fe8-bff1-c65a139af6fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.596201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a22d104f-df72-4fe8-bff1-c65a139af6fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:17.596632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a22d104f-df72-4fe8-bff1-c65a139af6fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:17.625561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a22d104f-df72-4fe8-bff1-c65a139af6fb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040711 Jun 17 12:57:17.626162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 406/805] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:18.470317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:18.471024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:18.477918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.478369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.479121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.479597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.618688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:18.626929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7a629483-6964-4066-b2cb-4d9cc1f231fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163195 Jun 17 12:57:18.627290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 407/806] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:18.631840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:18.632646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:18.638895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.639357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.640198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.640627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.701168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:18.709138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-95e48025-a917-4d25-ae91-de77892b30af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080879 Jun 17 12:57:18.709692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 408/807] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:18 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:18.714258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-95b00a61-002e-48dd-a56b-ceb77e441cb0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:18.715165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-95b00a61-002e-48dd-a56b-ceb77e441cb0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:18.721065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95b00a61-002e-48dd-a56b-ceb77e441cb0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.721435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95b00a61-002e-48dd-a56b-ceb77e441cb0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.722185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95b00a61-002e-48dd-a56b-ceb77e441cb0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.722616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95b00a61-002e-48dd-a56b-ceb77e441cb0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.752368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-95b00a61-002e-48dd-a56b-ceb77e441cb0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041690 Jun 17 12:57:18.752913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 409/808] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:18.757427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f570fcd0-61e1-4b38-b4e9-56882c51b132 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:18.758308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f570fcd0-61e1-4b38-b4e9-56882c51b132 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:18.764226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f570fcd0-61e1-4b38-b4e9-56882c51b132 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.764694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f570fcd0-61e1-4b38-b4e9-56882c51b132 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.765440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f570fcd0-61e1-4b38-b4e9-56882c51b132 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:18.765868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f570fcd0-61e1-4b38-b4e9-56882c51b132 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:18.795571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f570fcd0-61e1-4b38-b4e9-56882c51b132 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041644 Jun 17 12:57:18.796127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 410/809] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:19.647267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:19.648473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:19.659197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.659679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:19.660605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.661066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:19.812584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:19.821032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-68dceeec-a434-4ede-955d-e76940f79a0f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.180305 Jun 17 12:57:19.821599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 411/810] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:19.826150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:19.826751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:19.832883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.833329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:19.834091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.834532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:19.902016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:19.909895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-13fd5771-a38e-4aef-acc6-2409ea63ff0e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087245 Jun 17 12:57:19.910455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 412/811] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:19 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:19.915096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c84ac49c-599e-4b81-b2cf-1f7d027d93ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:19.916026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c84ac49c-599e-4b81-b2cf-1f7d027d93ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:19.921964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c84ac49c-599e-4b81-b2cf-1f7d027d93ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.922411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c84ac49c-599e-4b81-b2cf-1f7d027d93ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:19.923172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c84ac49c-599e-4b81-b2cf-1f7d027d93ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.923681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c84ac49c-599e-4b81-b2cf-1f7d027d93ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:19.958181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c84ac49c-599e-4b81-b2cf-1f7d027d93ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046618 Jun 17 12:57:19.958740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 413/812] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:19.963318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4224f51c-72be-4b84-9dcc-38dab777dff7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:19.964441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4224f51c-72be-4b84-9dcc-38dab777dff7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:19.970577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4224f51c-72be-4b84-9dcc-38dab777dff7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.971054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4224f51c-72be-4b84-9dcc-38dab777dff7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:19.971832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4224f51c-72be-4b84-9dcc-38dab777dff7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:19.972271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4224f51c-72be-4b84-9dcc-38dab777dff7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:20.004070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4224f51c-72be-4b84-9dcc-38dab777dff7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Jun 17 12:57:20.004623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 414/813] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:20.846025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:20.847111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:20.859063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:20.859846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:20.861635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:20.862075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:21.006843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:21.014890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-051b02e7-d583-46ef-9721-7e820bc9e067 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.179102 Jun 17 12:57:21.015467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 415/814] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:20 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:21.020462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:21.021050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:21.027013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:21.027485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:21.028237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:21.028662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:21.100125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:21.108340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-366cabec-b025-4187-80ad-22df614e44cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091885 Jun 17 12:57:21.108897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 416/815] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:21 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:21.114158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d82a6914-8bbd-4c04-a64d-8c4a80e987ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:21.115118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d82a6914-8bbd-4c04-a64d-8c4a80e987ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:21.121791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d82a6914-8bbd-4c04-a64d-8c4a80e987ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:21.122241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d82a6914-8bbd-4c04-a64d-8c4a80e987ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:21.122994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d82a6914-8bbd-4c04-a64d-8c4a80e987ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:21.123414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d82a6914-8bbd-4c04-a64d-8c4a80e987ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:21.153053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d82a6914-8bbd-4c04-a64d-8c4a80e987ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043130 Jun 17 12:57:21.153619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 417/816] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:21.158637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-797658cf-e18f-408f-a43c-52e1c835c567 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:21.159652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-797658cf-e18f-408f-a43c-52e1c835c567 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:21.165793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-797658cf-e18f-408f-a43c-52e1c835c567 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:21.166240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-797658cf-e18f-408f-a43c-52e1c835c567 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:21.166999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-797658cf-e18f-408f-a43c-52e1c835c567 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:21.167426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-797658cf-e18f-408f-a43c-52e1c835c567 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:21.196646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-797658cf-e18f-408f-a43c-52e1c835c567 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042022 Jun 17 12:57:21.197200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 418/817] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:22.033641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:22.034409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:22.042110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.042594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.043517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.044029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.181629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:22.189701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-65e3dc59-47d1-4e42-865d-932f47f2d64a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160913 Jun 17 12:57:22.190274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 419/818] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:22.194733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:22.195341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:22.201336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.201814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.202574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.203040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.274197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:22.282254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c122743c-690e-4f47-a907-923d62308b3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091044 Jun 17 12:57:22.282802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 420/819] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:22 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:22.287892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6ec76740-550a-4765-9777-ed1dd2e354b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:22.288742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6ec76740-550a-4765-9777-ed1dd2e354b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:22.294493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec76740-550a-4765-9777-ed1dd2e354b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.294931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec76740-550a-4765-9777-ed1dd2e354b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.295717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec76740-550a-4765-9777-ed1dd2e354b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.296144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec76740-550a-4765-9777-ed1dd2e354b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.299779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:22.326215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6ec76740-550a-4765-9777-ed1dd2e354b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042391 Jun 17 12:57:22.326769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 421/820] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:22.331198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9435809a-bdea-4433-aff4-713758badf44 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:22.332109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9435809a-bdea-4433-aff4-713758badf44 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:22.338084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9435809a-bdea-4433-aff4-713758badf44 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.338528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9435809a-bdea-4433-aff4-713758badf44 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.339273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9435809a-bdea-4433-aff4-713758badf44 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:22.339741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9435809a-bdea-4433-aff4-713758badf44 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:22.368968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9435809a-bdea-4433-aff4-713758badf44 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041234 Jun 17 12:57:22.369502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 422/821] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:23.209022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:23.209736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:23.212213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:23.218168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.218639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.219467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.219912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.369110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:23.377053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fccf74b7-ac7f-45c0-8d3e-cc16771eee99 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172238 Jun 17 12:57:23.377614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 423/822] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:23.382096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:23.382695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:23.388613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.389058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.389815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.390243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.454573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:23.462745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-774704cd-ccb4-4301-8cdc-50d7308853ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084149 Jun 17 12:57:23.463416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 424/823] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:23 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:23.467909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0afdc46f-0676-40a1-b732-cb8dee4beec2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:23.468802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0afdc46f-0676-40a1-b732-cb8dee4beec2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:23.474830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afdc46f-0676-40a1-b732-cb8dee4beec2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.475275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afdc46f-0676-40a1-b732-cb8dee4beec2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.476060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afdc46f-0676-40a1-b732-cb8dee4beec2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.476490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afdc46f-0676-40a1-b732-cb8dee4beec2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.507118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0afdc46f-0676-40a1-b732-cb8dee4beec2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042738 Jun 17 12:57:23.507705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 425/824] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:23.512264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-93f8950b-cfd9-493b-b3c4-f00fd5f8c71e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:23.513161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-93f8950b-cfd9-493b-b3c4-f00fd5f8c71e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:23.518846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f8950b-cfd9-493b-b3c4-f00fd5f8c71e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.519290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f8950b-cfd9-493b-b3c4-f00fd5f8c71e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.520069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f8950b-cfd9-493b-b3c4-f00fd5f8c71e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:23.520703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f8950b-cfd9-493b-b3c4-f00fd5f8c71e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:23.549989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-93f8950b-cfd9-493b-b3c4-f00fd5f8c71e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041312 Jun 17 12:57:23.550524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 426/825] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:24.398193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:24.398937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:24.407047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.407619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.408505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.409019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.557137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:24.565049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b3d50d96-3b41-4d5b-9481-10e49395dc98 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173092 Jun 17 12:57:24.565610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 427/826] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:24.570071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:24.570674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:24.577130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.577583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.578388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.578822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.649116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:24.656753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-613af89c-6e2b-478f-8c3f-3474859f7fdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.090234 Jun 17 12:57:24.657317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 428/827] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:24 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:24.662401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-97637050-400a-44e5-8001-3c5adbb673c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:24.663313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-97637050-400a-44e5-8001-3c5adbb673c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:24.669552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97637050-400a-44e5-8001-3c5adbb673c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.670000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97637050-400a-44e5-8001-3c5adbb673c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.670791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97637050-400a-44e5-8001-3c5adbb673c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.671219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97637050-400a-44e5-8001-3c5adbb673c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.699831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-97637050-400a-44e5-8001-3c5adbb673c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041276 Jun 17 12:57:24.700379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 429/828] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:24.704952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e877756c-dc49-4602-9ec1-b0ed936c0a32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:24.705830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e877756c-dc49-4602-9ec1-b0ed936c0a32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:24.711574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e877756c-dc49-4602-9ec1-b0ed936c0a32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.712014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e877756c-dc49-4602-9ec1-b0ed936c0a32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.712757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e877756c-dc49-4602-9ec1-b0ed936c0a32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:24.713186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e877756c-dc49-4602-9ec1-b0ed936c0a32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:24.741555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e877756c-dc49-4602-9ec1-b0ed936c0a32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040140 Jun 17 12:57:24.742107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 430/829] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:25.586393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:25.587069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:25.594390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.594858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.595693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.596160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.738006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:25.746281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-185d5f35-cbf6-4ddd-90f0-13920c0fd7bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166520 Jun 17 12:57:25.746839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 431/830] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:25.751340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:25.751968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:25.758058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.758511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.759267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.759800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.821235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:25.828958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d86b264a-ac5d-4abe-98c4-bc5d7970435d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081085 Jun 17 12:57:25.829521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 432/831] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:25 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:25.834003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8eb2739b-927f-4b2a-88a2-7e4822220ac6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:25.834905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8eb2739b-927f-4b2a-88a2-7e4822220ac6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:25.841155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb2739b-927f-4b2a-88a2-7e4822220ac6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.841519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb2739b-927f-4b2a-88a2-7e4822220ac6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.842340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb2739b-927f-4b2a-88a2-7e4822220ac6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.842794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb2739b-927f-4b2a-88a2-7e4822220ac6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.874128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8eb2739b-927f-4b2a-88a2-7e4822220ac6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043607 Jun 17 12:57:25.874677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 433/832] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:25.879113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ac06db61-f8bc-4fe5-9d94-f8a134143d40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:25.880031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ac06db61-f8bc-4fe5-9d94-f8a134143d40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:25.886127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac06db61-f8bc-4fe5-9d94-f8a134143d40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.886569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac06db61-f8bc-4fe5-9d94-f8a134143d40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.887322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac06db61-f8bc-4fe5-9d94-f8a134143d40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:25.887787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac06db61-f8bc-4fe5-9d94-f8a134143d40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:25.915306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ac06db61-f8bc-4fe5-9d94-f8a134143d40 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039662 Jun 17 12:57:25.915886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 434/833] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:26.767214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:26.768249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:26.779880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:26.780604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:26.781847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:26.782564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:26.926705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:26.934850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e8d0a4d6-7aa5-40ce-a3a2-5246af5c66ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.174137 Jun 17 12:57:26.935418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 435/834] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:26.939743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:26.940339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:26.946258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:26.946689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:26.947505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:26.947915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.015817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:27.026832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c9596cdc-32db-4743-b12a-1f3a8a176a8b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.090451 Jun 17 12:57:27.027400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 436/835] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:26 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:27.031953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ba50730-3123-44f7-aa6e-4b1bab2b1baa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:27.032835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ba50730-3123-44f7-aa6e-4b1bab2b1baa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:27.038740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba50730-3123-44f7-aa6e-4b1bab2b1baa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.039178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba50730-3123-44f7-aa6e-4b1bab2b1baa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.040499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba50730-3123-44f7-aa6e-4b1bab2b1baa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.040931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba50730-3123-44f7-aa6e-4b1bab2b1baa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.066305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:27.072023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ba50730-3123-44f7-aa6e-4b1bab2b1baa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043075 Jun 17 12:57:27.072592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 437/836] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:27.077148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e36a7f64-1606-4ea0-b960-9c1cf1c33ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:27.078032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e36a7f64-1606-4ea0-b960-9c1cf1c33ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:27.084058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e36a7f64-1606-4ea0-b960-9c1cf1c33ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.084496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e36a7f64-1606-4ea0-b960-9c1cf1c33ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.085274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e36a7f64-1606-4ea0-b960-9c1cf1c33ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.085697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e36a7f64-1606-4ea0-b960-9c1cf1c33ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.117003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e36a7f64-1606-4ea0-b960-9c1cf1c33ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Jun 17 12:57:27.117599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 438/837] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:27.956182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:27.957149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:27.966011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.966451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.967204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.967655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:28.102507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:28.110643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-da061a97-56f3-4050-b35b-b7665b74b4b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.161064 Jun 17 12:57:28.116602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 439/838] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:28.116602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:28.117366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:28.123701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:28.124150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:28.124923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:28.125358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:28.191777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:28.199660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e997b64c-39fb-422f-afd0-9bdc89060eb8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087075 Jun 17 12:57:28.200220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 440/839] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:28 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:28.204717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-46f32ac1-f0c1-43ef-9835-9a68cbfa378d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:28.205657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-46f32ac1-f0c1-43ef-9835-9a68cbfa378d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:28.211498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46f32ac1-f0c1-43ef-9835-9a68cbfa378d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:28.211891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46f32ac1-f0c1-43ef-9835-9a68cbfa378d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:28.212694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46f32ac1-f0c1-43ef-9835-9a68cbfa378d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:28.213134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46f32ac1-f0c1-43ef-9835-9a68cbfa378d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:28.245861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-46f32ac1-f0c1-43ef-9835-9a68cbfa378d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044632 Jun 17 12:57:28.246736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 441/840] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:28.251491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bdf6364c-3e82-42ef-9d91-cab091c801cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:28.252423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bdf6364c-3e82-42ef-9d91-cab091c801cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:28.258471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf6364c-3e82-42ef-9d91-cab091c801cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:28.258986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf6364c-3e82-42ef-9d91-cab091c801cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:28.259799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf6364c-3e82-42ef-9d91-cab091c801cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:28.260237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf6364c-3e82-42ef-9d91-cab091c801cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:28.289983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bdf6364c-3e82-42ef-9d91-cab091c801cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Jun 17 12:57:28.290579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 442/841] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:29.130864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:29.131492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:29.139863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.140317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.141079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.141508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.277712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:29.288660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6cc16475-3a1f-49d6-89eb-d5d502b05ade tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163931 Jun 17 12:57:29.289274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 443/842] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:29.293795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:29.294390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:29.301082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.301696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.302875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.303523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.376780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:29.384659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9e055c04-9839-4c0a-aa7f-6c1dca2d6455 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094412 Jun 17 12:57:29.385315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 444/843] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:29 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:29.390103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48e09993-65e4-4d7c-9232-16dd245820ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:29.391007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48e09993-65e4-4d7c-9232-16dd245820ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:29.397028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e09993-65e4-4d7c-9232-16dd245820ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.397492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e09993-65e4-4d7c-9232-16dd245820ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.398230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e09993-65e4-4d7c-9232-16dd245820ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.398659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e09993-65e4-4d7c-9232-16dd245820ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.428410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48e09993-65e4-4d7c-9232-16dd245820ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042072 Jun 17 12:57:29.428968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 445/844] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:29.433573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6a7d0f09-efd0-4ea8-aa87-8f22306ef2dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:29.434473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6a7d0f09-efd0-4ea8-aa87-8f22306ef2dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:29.440580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a7d0f09-efd0-4ea8-aa87-8f22306ef2dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.441019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a7d0f09-efd0-4ea8-aa87-8f22306ef2dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.441769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a7d0f09-efd0-4ea8-aa87-8f22306ef2dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.442189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a7d0f09-efd0-4ea8-aa87-8f22306ef2dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.472598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6a7d0f09-efd0-4ea8-aa87-8f22306ef2dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Jun 17 12:57:29.473143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 446/845] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:30.309780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:30.310611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:30.319404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.319978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.320939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.321523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.469278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:30.476983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6afd115b-faa0-4e80-9270-e9029f146599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173445 Jun 17 12:57:30.477547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 447/846] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:30 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:30.483631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:30.484232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:30.490717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.491157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.491958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.492389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.553804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:30.561796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-290c4b51-1e1b-4f4e-ab70-0481fb65eac0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081700 Jun 17 12:57:30.562364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 448/847] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:30 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:30.567132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7d8ae3d4-399b-45bc-a87c-a24efb0f8f21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:30.568060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7d8ae3d4-399b-45bc-a87c-a24efb0f8f21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:30.574174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d8ae3d4-399b-45bc-a87c-a24efb0f8f21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.574615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d8ae3d4-399b-45bc-a87c-a24efb0f8f21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.575391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d8ae3d4-399b-45bc-a87c-a24efb0f8f21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.575824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d8ae3d4-399b-45bc-a87c-a24efb0f8f21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.604712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7d8ae3d4-399b-45bc-a87c-a24efb0f8f21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041362 Jun 17 12:57:30.605247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 449/848] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:30.609587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-584ba2f0-ff98-4852-a471-f1cf2ba12467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:30.610467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-584ba2f0-ff98-4852-a471-f1cf2ba12467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:30.616808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-584ba2f0-ff98-4852-a471-f1cf2ba12467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.617244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-584ba2f0-ff98-4852-a471-f1cf2ba12467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.617982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-584ba2f0-ff98-4852-a471-f1cf2ba12467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.618413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-584ba2f0-ff98-4852-a471-f1cf2ba12467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.652875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-584ba2f0-ff98-4852-a471-f1cf2ba12467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046649 Jun 17 12:57:30.653414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 450/849] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:31.497071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:31.497790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:31.504979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.505437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.506224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.506665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.647464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:31.655850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1e252bad-0994-48d8-93bc-2ea0128e26c3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164127 Jun 17 12:57:31.656413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 451/850] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:31.660799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:31.661389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:31.667689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.668128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.668872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.669295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.732229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:31.740037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-92959365-499d-4664-a9c2-3c3e9add2020 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082696 Jun 17 12:57:31.740596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 452/851] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:31 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:31.745231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df3fb829-8f3c-40eb-bb3a-8c099fcac104 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:31.746105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df3fb829-8f3c-40eb-bb3a-8c099fcac104 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:31.751780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df3fb829-8f3c-40eb-bb3a-8c099fcac104 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.752149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df3fb829-8f3c-40eb-bb3a-8c099fcac104 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.752887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df3fb829-8f3c-40eb-bb3a-8c099fcac104 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.753310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df3fb829-8f3c-40eb-bb3a-8c099fcac104 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.781427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df3fb829-8f3c-40eb-bb3a-8c099fcac104 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039884 Jun 17 12:57:31.781992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 453/852] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:31.786365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-168ebaa0-fd37-4381-b50f-cdcac4a994b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:31.787230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-168ebaa0-fd37-4381-b50f-cdcac4a994b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:31.792879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-168ebaa0-fd37-4381-b50f-cdcac4a994b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.793309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-168ebaa0-fd37-4381-b50f-cdcac4a994b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.794045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-168ebaa0-fd37-4381-b50f-cdcac4a994b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:31.794465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-168ebaa0-fd37-4381-b50f-cdcac4a994b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:31.810498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:31.824000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-168ebaa0-fd37-4381-b50f-cdcac4a994b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 Jun 17 12:57:31.824540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 454/853] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:32.677186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:32.678277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:32.689425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:32.690165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:32.691446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:32.692201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:32.863202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:32.876054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-60f222ec-33ef-4ff7-b23b-9029d292f60f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.205009 Jun 17 12:57:32.877036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 455/854] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:32.881871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:32.882471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:32.890817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:32.891446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:32.892587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:32.893113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:32.974189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:32.986741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f65508f8-736d-4c85-a657-5d9139ef8da3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.108302 Jun 17 12:57:32.988066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 456/855] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:32 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:32.994890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9602c507-895c-4db9-81d6-422707ec4a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:32.995883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9602c507-895c-4db9-81d6-422707ec4a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:33.002003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9602c507-895c-4db9-81d6-422707ec4a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.002447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9602c507-895c-4db9-81d6-422707ec4a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.003209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9602c507-895c-4db9-81d6-422707ec4a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.003673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9602c507-895c-4db9-81d6-422707ec4a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.033706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9602c507-895c-4db9-81d6-422707ec4a28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044361 Jun 17 12:57:33.034253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 457/856] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:33.038632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-578ec61f-1356-43c7-8449-82b61b515b22 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:33.039546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-578ec61f-1356-43c7-8449-82b61b515b22 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:33.045298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-578ec61f-1356-43c7-8449-82b61b515b22 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.045743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-578ec61f-1356-43c7-8449-82b61b515b22 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.046496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-578ec61f-1356-43c7-8449-82b61b515b22 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.046926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-578ec61f-1356-43c7-8449-82b61b515b22 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.075043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-578ec61f-1356-43c7-8449-82b61b515b22 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039818 Jun 17 12:57:33.075611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 458/857] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:33.897991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:33.899100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:33.906639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.907093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.907902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.908334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.047314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:34.060911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-22da942d-e524-4b02-b56a-2511bc1232c2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169379 Jun 17 12:57:34.061501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 459/858] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:34.066042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:34.066644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:34.073168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.073617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.074414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.074846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.137648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:34.145881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4ab53ed3-ffaa-49f7-b9fb-85bd7bf8ff5c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083399 Jun 17 12:57:34.146468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 460/859] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:34 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:34.151405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2791181a-b65a-47de-aebf-934cfd170753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:34.152250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2791181a-b65a-47de-aebf-934cfd170753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:34.158447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2791181a-b65a-47de-aebf-934cfd170753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.158874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2791181a-b65a-47de-aebf-934cfd170753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.159671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2791181a-b65a-47de-aebf-934cfd170753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.160101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2791181a-b65a-47de-aebf-934cfd170753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.189960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2791181a-b65a-47de-aebf-934cfd170753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042524 Jun 17 12:57:34.190509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 461/860] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:34.194997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b9653f98-bcfc-4adc-bcc6-73dc92ed9c5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:34.195920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b9653f98-bcfc-4adc-bcc6-73dc92ed9c5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:34.201803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9653f98-bcfc-4adc-bcc6-73dc92ed9c5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.202280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9653f98-bcfc-4adc-bcc6-73dc92ed9c5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.203033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9653f98-bcfc-4adc-bcc6-73dc92ed9c5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.203500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9653f98-bcfc-4adc-bcc6-73dc92ed9c5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.232125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b9653f98-bcfc-4adc-bcc6-73dc92ed9c5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040643 Jun 17 12:57:34.232677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 462/861] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:35.078946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:35.079694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:35.086738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.087188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.088031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.088465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.249867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:35.257823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7d927ef0-2c7f-44d0-ad1a-f8c9120b36d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.182830 Jun 17 12:57:35.258396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 463/862] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:35.262929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:35.263535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:35.269298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.269745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.270501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.270933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.332326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:35.340372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-96268b98-0bde-457f-8aef-23de043a6303 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080964 Jun 17 12:57:35.340940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 464/863] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:35 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:35.345599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70c16ded-ede6-4c52-9c74-ac724db71e92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:35.346504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70c16ded-ede6-4c52-9c74-ac724db71e92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:35.354651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c16ded-ede6-4c52-9c74-ac724db71e92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.355340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c16ded-ede6-4c52-9c74-ac724db71e92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.356679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c16ded-ede6-4c52-9c74-ac724db71e92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.357317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c16ded-ede6-4c52-9c74-ac724db71e92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.391434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70c16ded-ede6-4c52-9c74-ac724db71e92 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049470 Jun 17 12:57:35.391981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 465/864] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:35.396428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a8a3ea32-59bc-4656-a2d7-caad6ca8dd7b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:35.397330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a8a3ea32-59bc-4656-a2d7-caad6ca8dd7b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:35.403176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8a3ea32-59bc-4656-a2d7-caad6ca8dd7b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.403649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8a3ea32-59bc-4656-a2d7-caad6ca8dd7b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.404404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8a3ea32-59bc-4656-a2d7-caad6ca8dd7b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.404830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8a3ea32-59bc-4656-a2d7-caad6ca8dd7b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.433296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a8a3ea32-59bc-4656-a2d7-caad6ca8dd7b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040281 Jun 17 12:57:35.433833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 466/865] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:36.275904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:36.276623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:36.283552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.284002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.284782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.285214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.422560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.430392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bfdddc8f-2d1c-4a88-abaf-d7ec12c2af3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158619 Jun 17 12:57:36.430964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 467/866] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:36.435519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:36.436158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:36.442353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.442805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.443635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.444102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.511364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.519265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f969a385-14b8-4470-9a5d-b031083f2da2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087310 Jun 17 12:57:36.519863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 468/867] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:36 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:36.524439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b63d385f-d98f-4048-8ac6-be7dafc2a546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:36.525385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b63d385f-d98f-4048-8ac6-be7dafc2a546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:36.531468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b63d385f-d98f-4048-8ac6-be7dafc2a546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.531918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b63d385f-d98f-4048-8ac6-be7dafc2a546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.532680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b63d385f-d98f-4048-8ac6-be7dafc2a546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.533109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b63d385f-d98f-4048-8ac6-be7dafc2a546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.563531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b63d385f-d98f-4048-8ac6-be7dafc2a546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042617 Jun 17 12:57:36.564075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 469/868] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:36.568740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad24f103-e29d-41b5-92d9-d00bfd5b8d17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:36.569629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad24f103-e29d-41b5-92d9-d00bfd5b8d17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:36.575539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad24f103-e29d-41b5-92d9-d00bfd5b8d17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.575969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad24f103-e29d-41b5-92d9-d00bfd5b8d17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.576723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad24f103-e29d-41b5-92d9-d00bfd5b8d17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.577164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad24f103-e29d-41b5-92d9-d00bfd5b8d17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.606963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad24f103-e29d-41b5-92d9-d00bfd5b8d17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Jun 17 12:57:36.607543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 470/869] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:37.452071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:37.453133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:37.463580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.464315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.465629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.466063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.470079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:37.597627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:37.609740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f971d187-ce75-472e-868a-9a6a93435aa5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164189 Jun 17 12:57:37.610523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 471/870] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:37.616757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:37.617632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:37.624903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.625345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.626106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.626563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.690310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:37.702846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2a6f57b5-f43f-4022-b3ae-a3655a41524d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.090748 Jun 17 12:57:37.703600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 472/871] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:37 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:37.710923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6ef913bc-7617-46eb-b8da-e34b9286d090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:37.712353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6ef913bc-7617-46eb-b8da-e34b9286d090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:37.714915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:37.720929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ef913bc-7617-46eb-b8da-e34b9286d090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.721361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ef913bc-7617-46eb-b8da-e34b9286d090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.722142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ef913bc-7617-46eb-b8da-e34b9286d090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.722562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ef913bc-7617-46eb-b8da-e34b9286d090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.752245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6ef913bc-7617-46eb-b8da-e34b9286d090 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047345 Jun 17 12:57:37.753004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 473/872] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:37.757464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-74aceb96-fcfd-432b-a853-ab79bdb2a5d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:37.758355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-74aceb96-fcfd-432b-a853-ab79bdb2a5d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:37.764120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74aceb96-fcfd-432b-a853-ab79bdb2a5d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.764567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74aceb96-fcfd-432b-a853-ab79bdb2a5d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.765315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74aceb96-fcfd-432b-a853-ab79bdb2a5d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.765748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74aceb96-fcfd-432b-a853-ab79bdb2a5d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.794372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-74aceb96-fcfd-432b-a853-ab79bdb2a5d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040538 Jun 17 12:57:37.794927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 474/873] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:38.633192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:38.634107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:38.642731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.643210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.644002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.644435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.787869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:38.796085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-093dc771-34be-411b-8c52-b7c86cab6367 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168456 Jun 17 12:57:38.796642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 475/874] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:38.801213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:38.801882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:38.807853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.808299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.809053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.809487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.876798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:38.884804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6a855a5f-358c-4b5b-88c0-c5bc5591a7f3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087124 Jun 17 12:57:38.885292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 476/875] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:38 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:38.890100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8cc66c3e-f72f-4749-8d36-5dc4bd4c1591 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:38.891010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8cc66c3e-f72f-4749-8d36-5dc4bd4c1591 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:38.897276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8cc66c3e-f72f-4749-8d36-5dc4bd4c1591 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.897718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8cc66c3e-f72f-4749-8d36-5dc4bd4c1591 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.898478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8cc66c3e-f72f-4749-8d36-5dc4bd4c1591 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.898906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8cc66c3e-f72f-4749-8d36-5dc4bd4c1591 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.928887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8cc66c3e-f72f-4749-8d36-5dc4bd4c1591 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042486 Jun 17 12:57:38.929497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 477/876] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:38.934202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-86e3656e-ecbd-45ff-8f78-c76eaa33391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:38.935130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-86e3656e-ecbd-45ff-8f78-c76eaa33391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:38.941090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86e3656e-ecbd-45ff-8f78-c76eaa33391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.941518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86e3656e-ecbd-45ff-8f78-c76eaa33391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.942262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86e3656e-ecbd-45ff-8f78-c76eaa33391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.942683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-86e3656e-ecbd-45ff-8f78-c76eaa33391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.973511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-86e3656e-ecbd-45ff-8f78-c76eaa33391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Jun 17 12:57:38.974311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 478/877] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:39.817081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:39.818212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:39.829663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:39.830398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:39.831717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:39.832432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:39.983484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:39.991767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1ba2477c-09f1-41f8-a0ae-0cc073a5101f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.181315 Jun 17 12:57:39.992359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 479/878] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:39.996952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:39.997550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:40.007420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.007892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.008658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.009091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.076010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:40.083942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c6f3e4c6-2589-4e63-a17f-357211a958af tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.090599 Jun 17 12:57:40.084511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 480/879] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:39 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:40.089034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-156ceaa7-272a-4c15-8953-c43d50441b7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:40.089943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-156ceaa7-272a-4c15-8953-c43d50441b7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:40.096081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-156ceaa7-272a-4c15-8953-c43d50441b7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.096524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-156ceaa7-272a-4c15-8953-c43d50441b7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.097278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-156ceaa7-272a-4c15-8953-c43d50441b7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.097715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-156ceaa7-272a-4c15-8953-c43d50441b7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.129210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-156ceaa7-272a-4c15-8953-c43d50441b7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043683 Jun 17 12:57:40.129843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 481/880] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:40.134479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cdbf7528-3a56-4c9b-830a-10f951ac43c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:40.135413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cdbf7528-3a56-4c9b-830a-10f951ac43c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:40.141188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdbf7528-3a56-4c9b-830a-10f951ac43c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.141637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdbf7528-3a56-4c9b-830a-10f951ac43c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.142387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdbf7528-3a56-4c9b-830a-10f951ac43c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.142815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdbf7528-3a56-4c9b-830a-10f951ac43c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.172707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cdbf7528-3a56-4c9b-830a-10f951ac43c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041804 Jun 17 12:57:40.173262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 482/881] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:41.010874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:41.011626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:41.018858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.019307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.020114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.020549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.161122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:41.168856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cb345739-05e9-4463-902b-652c94d8ad04 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162008 Jun 17 12:57:41.169424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 483/882] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:41.173771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:41.174378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:41.180068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.180514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.181275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.181702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.242109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:41.249740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad5131fc-686a-42ed-bd4f-b6491de6c069 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.079374 Jun 17 12:57:41.250299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 484/883] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:41 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:41.254844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2ef065fe-e107-430d-87b0-195dd327f205 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:41.255776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2ef065fe-e107-430d-87b0-195dd327f205 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:41.261457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ef065fe-e107-430d-87b0-195dd327f205 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.261821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ef065fe-e107-430d-87b0-195dd327f205 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.262571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ef065fe-e107-430d-87b0-195dd327f205 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.262999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ef065fe-e107-430d-87b0-195dd327f205 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.292827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2ef065fe-e107-430d-87b0-195dd327f205 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041533 Jun 17 12:57:41.293379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 485/884] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:41.297800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a280040-819c-45cd-8dc8-831a438abc49 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:41.298694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a280040-819c-45cd-8dc8-831a438abc49 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:41.304819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a280040-819c-45cd-8dc8-831a438abc49 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.305232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a280040-819c-45cd-8dc8-831a438abc49 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.305985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a280040-819c-45cd-8dc8-831a438abc49 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.306406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a280040-819c-45cd-8dc8-831a438abc49 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.347380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a280040-819c-45cd-8dc8-831a438abc49 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053046 Jun 17 12:57:41.347963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 486/885] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:42.188914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:42.189546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:42.196519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.196960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.197754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.198183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.348776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:42.353457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:42.359411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5f34f368-36a1-4d95-8b80-744f7b891154 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175753 Jun 17 12:57:42.360000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 487/886] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:42.365178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:42.365774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:42.371672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.372114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.372870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.373643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.435197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:42.446409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-024cc58a-31e6-430b-be69-091a18c1bbd4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085392 Jun 17 12:57:42.446947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 488/887] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:42 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:42.452274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-52db5e77-a7ee-40e4-afb5-0ac61bd23da5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:42.453194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-52db5e77-a7ee-40e4-afb5-0ac61bd23da5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:42.458844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52db5e77-a7ee-40e4-afb5-0ac61bd23da5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.459253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52db5e77-a7ee-40e4-afb5-0ac61bd23da5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.460029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52db5e77-a7ee-40e4-afb5-0ac61bd23da5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.460484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52db5e77-a7ee-40e4-afb5-0ac61bd23da5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.490324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-52db5e77-a7ee-40e4-afb5-0ac61bd23da5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042302 Jun 17 12:57:42.490869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 489/888] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:42.495336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-52372ccc-c8d2-43c1-9fec-d105eda35cfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:42.496255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-52372ccc-c8d2-43c1-9fec-d105eda35cfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:42.502638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52372ccc-c8d2-43c1-9fec-d105eda35cfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.503079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52372ccc-c8d2-43c1-9fec-d105eda35cfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.503860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52372ccc-c8d2-43c1-9fec-d105eda35cfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.504283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52372ccc-c8d2-43c1-9fec-d105eda35cfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.533403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-52372ccc-c8d2-43c1-9fec-d105eda35cfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Jun 17 12:57:42.533939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 490/889] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:43.378641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:43.379320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:43.386271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.386723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.387537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.387972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.550072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:43.557735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-78b97e49-e0ba-47fe-9e12-ace55b0954b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.183180 Jun 17 12:57:43.558360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 491/890] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:43.563195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:43.563803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:43.569526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.569973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.570720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.571154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.638808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:43.651541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5e553d36-8932-427a-b3c5-0898cd3aebf4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092180 Jun 17 12:57:43.652325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 492/891] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:43 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:43.657480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad01fe65-d4b9-4edd-b4f9-6e7c8fdd60e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:43.658385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad01fe65-d4b9-4edd-b4f9-6e7c8fdd60e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:43.664367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad01fe65-d4b9-4edd-b4f9-6e7c8fdd60e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.664776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad01fe65-d4b9-4edd-b4f9-6e7c8fdd60e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.665519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad01fe65-d4b9-4edd-b4f9-6e7c8fdd60e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.665941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad01fe65-d4b9-4edd-b4f9-6e7c8fdd60e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad01fe65-d4b9-4edd-b4f9-6e7c8fdd60e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047322 Jun 17 12:57:43.701222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 493/892] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:43.706613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3535151-6c93-4ae7-a10b-662ef78627e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:43.707539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3535151-6c93-4ae7-a10b-662ef78627e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:43.713923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3535151-6c93-4ae7-a10b-662ef78627e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.714370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3535151-6c93-4ae7-a10b-662ef78627e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.715125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3535151-6c93-4ae7-a10b-662ef78627e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.715587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3535151-6c93-4ae7-a10b-662ef78627e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.745028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3535151-6c93-4ae7-a10b-662ef78627e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042693 Jun 17 12:57:43.745578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 494/893] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:44.578414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:44.579178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:44.587010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.587557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.588410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.588902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.732214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:44.744216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-11990cbe-c11d-468c-b898-a321ad6c8e63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172326 Jun 17 12:57:44.744807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 495/894] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:44.751554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:44.752178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:44.760572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.761194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.762294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.762892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.837429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:44.847183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f7a7c3e0-5059-4d7b-bfc1-27e90483909c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.100552 Jun 17 12:57:44.847795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 496/895] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:44 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:44.852334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5fa84d6f-5023-492e-a2bf-5eb22bf5704e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:44.853248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5fa84d6f-5023-492e-a2bf-5eb22bf5704e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:44.859491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fa84d6f-5023-492e-a2bf-5eb22bf5704e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.859938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fa84d6f-5023-492e-a2bf-5eb22bf5704e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.860703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fa84d6f-5023-492e-a2bf-5eb22bf5704e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.861137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fa84d6f-5023-492e-a2bf-5eb22bf5704e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.891159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5fa84d6f-5023-492e-a2bf-5eb22bf5704e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042361 Jun 17 12:57:44.891747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 497/896] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:44.896123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a135b2c3-9c0d-49a0-b65c-7cb82371488f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:44.897009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a135b2c3-9c0d-49a0-b65c-7cb82371488f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:44.902689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a135b2c3-9c0d-49a0-b65c-7cb82371488f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.903132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a135b2c3-9c0d-49a0-b65c-7cb82371488f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.903908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a135b2c3-9c0d-49a0-b65c-7cb82371488f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.904341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a135b2c3-9c0d-49a0-b65c-7cb82371488f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.933480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a135b2c3-9c0d-49a0-b65c-7cb82371488f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040774 Jun 17 12:57:44.934026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 498/897] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:45.765912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:45.766939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:45.782193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:45.782637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:45.783401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:45.783860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:45.927187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:45.935401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-01ce6919-3523-4078-b781-847f7479d9a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.176297 Jun 17 12:57:45.936018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 499/898] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:45.940672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:45.941276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:45.947126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:45.947647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:45.948392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:45.948812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.009941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:46.018407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d3270036-8b0d-4e40-93d3-e83a98e15dd8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081393 Jun 17 12:57:46.018932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 500/899] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:45 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:46.023586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a13d071-34ce-4cec-9fa2-42b26412d6fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:46.024495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a13d071-34ce-4cec-9fa2-42b26412d6fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:46.030325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a13d071-34ce-4cec-9fa2-42b26412d6fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.030802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a13d071-34ce-4cec-9fa2-42b26412d6fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.031596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a13d071-34ce-4cec-9fa2-42b26412d6fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.032026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a13d071-34ce-4cec-9fa2-42b26412d6fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.062622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a13d071-34ce-4cec-9fa2-42b26412d6fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042420 Jun 17 12:57:46.063152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 501/900] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:46.067587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e7f968dc-8880-4c20-bc09-6a2dd3a456b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:46.068473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e7f968dc-8880-4c20-bc09-6a2dd3a456b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:46.074101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7f968dc-8880-4c20-bc09-6a2dd3a456b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.074541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7f968dc-8880-4c20-bc09-6a2dd3a456b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.075281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7f968dc-8880-4c20-bc09-6a2dd3a456b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.075755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7f968dc-8880-4c20-bc09-6a2dd3a456b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.104437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e7f968dc-8880-4c20-bc09-6a2dd3a456b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040259 Jun 17 12:57:46.104967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 502/901] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:46.956042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:46.956759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:46.964325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.964797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.965601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.966058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.107196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:47.116195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-94dc68d2-3900-4b50-bfd6-fd7d3a550fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165596 Jun 17 12:57:47.120114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 503/902] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:47.124838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:47.125606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:47.131773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.132223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.132988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.133419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.151340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:47.212969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:47.222855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-103ae4c5-1b96-4a5a-aaf1-eca1f816c2cb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.101710 Jun 17 12:57:47.223426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 504/903] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:47 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:47.227997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7b25036a-19ed-42ed-9984-6d59c5782983 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:47.228901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7b25036a-19ed-42ed-9984-6d59c5782983 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:47.235789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b25036a-19ed-42ed-9984-6d59c5782983 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.236236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b25036a-19ed-42ed-9984-6d59c5782983 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.236996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b25036a-19ed-42ed-9984-6d59c5782983 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.237425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b25036a-19ed-42ed-9984-6d59c5782983 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.267262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7b25036a-19ed-42ed-9984-6d59c5782983 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042788 Jun 17 12:57:47.267854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 505/904] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:47.272397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-17dafa0b-7796-4130-8861-a4e0faa23930 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:47.273331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-17dafa0b-7796-4130-8861-a4e0faa23930 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:47.279218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17dafa0b-7796-4130-8861-a4e0faa23930 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.279699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17dafa0b-7796-4130-8861-a4e0faa23930 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.280457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17dafa0b-7796-4130-8861-a4e0faa23930 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.280887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17dafa0b-7796-4130-8861-a4e0faa23930 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.309646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-17dafa0b-7796-4130-8861-a4e0faa23930 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040721 Jun 17 12:57:47.310195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 506/905] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:48.135983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:48.136620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:48.146828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.147447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.148548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.149023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.290500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.298469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f38d367-14cc-42fa-aee9-e4a24a3cfedf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168589 Jun 17 12:57:48.299062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 507/906] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:48.303779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:48.304668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:48.311404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.311862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.312657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.313090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.381064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.392059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d10511d9-7b91-41b3-b9ef-32c7ae4dde56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092008 Jun 17 12:57:48.392632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 508/907] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:48 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:48.397292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbc45019-5a11-4e2d-b2b1-69cdc87fa520 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:48.398204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cbc45019-5a11-4e2d-b2b1-69cdc87fa520 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:48.405896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc45019-5a11-4e2d-b2b1-69cdc87fa520 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.406494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc45019-5a11-4e2d-b2b1-69cdc87fa520 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.407907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc45019-5a11-4e2d-b2b1-69cdc87fa520 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.408455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc45019-5a11-4e2d-b2b1-69cdc87fa520 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.443111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cbc45019-5a11-4e2d-b2b1-69cdc87fa520 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049431 Jun 17 12:57:48.443706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 509/908] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:48.448327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aa2d83dc-48b2-41e6-8276-e4e27f692ce1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:48.449281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aa2d83dc-48b2-41e6-8276-e4e27f692ce1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:48.455011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2d83dc-48b2-41e6-8276-e4e27f692ce1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.455601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2d83dc-48b2-41e6-8276-e4e27f692ce1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.456385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2d83dc-48b2-41e6-8276-e4e27f692ce1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.456781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa2d83dc-48b2-41e6-8276-e4e27f692ce1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.651929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aa2d83dc-48b2-41e6-8276-e4e27f692ce1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206657 Jun 17 12:57:48.652665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 510/909] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:49.318028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.318799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.326496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.327027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.327911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.328384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.467571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.475714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-83e6d5d7-5b7c-427e-89ad-8a9ecbecee79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162014 Jun 17 12:57:49.476268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 511/910] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:49.480738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.481326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.487242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.487721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.488836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.489278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.550518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.558448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed1d568c-a6ed-4851-b280-337f0772fb34 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081248 Jun 17 12:57:49.558999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 512/911] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:49.563803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-521a10ce-4631-4a55-a391-5bf253ff4de3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.564705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-521a10ce-4631-4a55-a391-5bf253ff4de3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.570440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-521a10ce-4631-4a55-a391-5bf253ff4de3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.570885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-521a10ce-4631-4a55-a391-5bf253ff4de3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.571665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-521a10ce-4631-4a55-a391-5bf253ff4de3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.572093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-521a10ce-4631-4a55-a391-5bf253ff4de3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.602527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-521a10ce-4631-4a55-a391-5bf253ff4de3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042517 Jun 17 12:57:49.603054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 513/912] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:49.669967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6f2d012b-6709-4930-b29d-38c9f569f4e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.671312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6f2d012b-6709-4930-b29d-38c9f569f4e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.681290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f2d012b-6709-4930-b29d-38c9f569f4e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.682020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f2d012b-6709-4930-b29d-38c9f569f4e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.683316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f2d012b-6709-4930-b29d-38c9f569f4e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.684067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f2d012b-6709-4930-b29d-38c9f569f4e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.715348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6f2d012b-6709-4930-b29d-38c9f569f4e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051757 Jun 17 12:57:49.715937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 514/913] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:50.493450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.494153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.501098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.501539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.502350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.503265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.640370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:50.648954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7a5e0021-5cc2-450a-9ab7-9ebddaf68af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.159420 Jun 17 12:57:50.649514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 515/914] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:50.653982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.654579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.660594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.661036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.662220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.728222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:50.737450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-00f0807a-3adc-4e38-96f0-882daf8f94f8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086802 Jun 17 12:57:50.738340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 516/915] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:50.742921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-729b96d0-5a28-450e-b797-3f67bcff673d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.743915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-729b96d0-5a28-450e-b797-3f67bcff673d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.749853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-729b96d0-5a28-450e-b797-3f67bcff673d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.750297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-729b96d0-5a28-450e-b797-3f67bcff673d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.751075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-729b96d0-5a28-450e-b797-3f67bcff673d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.751527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-729b96d0-5a28-450e-b797-3f67bcff673d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.781580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-729b96d0-5a28-450e-b797-3f67bcff673d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042218 Jun 17 12:57:50.782121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 517/916] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:50.786776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ca8104c7-ac70-4aae-89f8-c8f93fd99965 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.787677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ca8104c7-ac70-4aae-89f8-c8f93fd99965 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.793378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8104c7-ac70-4aae-89f8-c8f93fd99965 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.793821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8104c7-ac70-4aae-89f8-c8f93fd99965 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.794570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8104c7-ac70-4aae-89f8-c8f93fd99965 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.794996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8104c7-ac70-4aae-89f8-c8f93fd99965 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.823659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ca8104c7-ac70-4aae-89f8-c8f93fd99965 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040552 Jun 17 12:57:50.824215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 518/917] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:51.670345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:51.671484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:51.683152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:51.683941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:51.685177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:51.685876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.056675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:52.064449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e3aad7f7-f32b-4f2f-a322-cb3d28d10ce3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.400856 Jun 17 12:57:52.065095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 519/918] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:52.069687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:52.070376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:52.077254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.077854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.078929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.079545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.141764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:52.149897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-796d4979-eb28-4e23-b93d-673a9e70b287 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083830 Jun 17 12:57:52.150444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 520/919] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:52.154887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3674fcd-8a58-4d6d-85f9-385429d0a794 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:52.155831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3674fcd-8a58-4d6d-85f9-385429d0a794 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:52.161968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3674fcd-8a58-4d6d-85f9-385429d0a794 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.162434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3674fcd-8a58-4d6d-85f9-385429d0a794 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.163228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3674fcd-8a58-4d6d-85f9-385429d0a794 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.163699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3674fcd-8a58-4d6d-85f9-385429d0a794 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.167406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:52.192682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3674fcd-8a58-4d6d-85f9-385429d0a794 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041260 Jun 17 12:57:52.193209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 521/920] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:52.197636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70c60cc0-c1e6-4f7d-9b79-2b6cadc4d43a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:52.198514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70c60cc0-c1e6-4f7d-9b79-2b6cadc4d43a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:52.204179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c60cc0-c1e6-4f7d-9b79-2b6cadc4d43a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.204621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c60cc0-c1e6-4f7d-9b79-2b6cadc4d43a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.205383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c60cc0-c1e6-4f7d-9b79-2b6cadc4d43a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.205896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70c60cc0-c1e6-4f7d-9b79-2b6cadc4d43a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.233784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70c60cc0-c1e6-4f7d-9b79-2b6cadc4d43a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039586 Jun 17 12:57:52.234306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 522/921] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:53.085860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:53.086941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:53.090609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:53.098467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.098908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.099704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.100128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.234649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.244783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9987fe37-ec23-4bcb-a1a7-b7049260ec72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165556 Jun 17 12:57:53.245343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 523/922] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:53.250151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:53.250755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:53.257327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.257775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.258540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.258971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.324549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.332455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b6a2f696-4af4-4027-bd15-578877f4dea5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086168 Jun 17 12:57:53.333022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 524/923] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:53 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:53.337599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d389ac18-3bb6-4c2a-b6e2-c33ad9af63e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:53.338438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d389ac18-3bb6-4c2a-b6e2-c33ad9af63e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:53.345092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d389ac18-3bb6-4c2a-b6e2-c33ad9af63e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.345541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d389ac18-3bb6-4c2a-b6e2-c33ad9af63e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.346371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d389ac18-3bb6-4c2a-b6e2-c33ad9af63e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.346833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d389ac18-3bb6-4c2a-b6e2-c33ad9af63e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.375730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d389ac18-3bb6-4c2a-b6e2-c33ad9af63e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041679 Jun 17 12:57:53.376268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 525/924] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:53.380750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6dd49654-9f66-470f-a2f7-476a5ac101d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:53.381656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6dd49654-9f66-470f-a2f7-476a5ac101d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:53.387762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6dd49654-9f66-470f-a2f7-476a5ac101d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.388199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6dd49654-9f66-470f-a2f7-476a5ac101d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.388946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6dd49654-9f66-470f-a2f7-476a5ac101d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.389371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6dd49654-9f66-470f-a2f7-476a5ac101d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.419390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6dd49654-9f66-470f-a2f7-476a5ac101d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Jun 17 12:57:53.419953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 526/925] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:54.266403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.267488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.274993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.275397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.276168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.276602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.406307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.414842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5773681d-bb48-4b4d-9f8a-0902db6d19d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.155059 Jun 17 12:57:54.415387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 527/926] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:54.420309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.420894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.427518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.427955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.428704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.429127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.504450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.515788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d2244d43-5e1a-4bd6-be2a-ac57d8ef8f83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.098549 Jun 17 12:57:54.516545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 528/927] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:54.521711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0997c42e-4cc4-4fc3-87ef-2b611f7938b5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.522623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0997c42e-4cc4-4fc3-87ef-2b611f7938b5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.528781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0997c42e-4cc4-4fc3-87ef-2b611f7938b5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.529154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0997c42e-4cc4-4fc3-87ef-2b611f7938b5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.529913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0997c42e-4cc4-4fc3-87ef-2b611f7938b5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.530347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0997c42e-4cc4-4fc3-87ef-2b611f7938b5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.561814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0997c42e-4cc4-4fc3-87ef-2b611f7938b5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044140 Jun 17 12:57:54.562364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 529/928] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:54.566937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c81be3f4-88e5-44c4-8b74-3c0e006dd81c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.567905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c81be3f4-88e5-44c4-8b74-3c0e006dd81c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.574047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c81be3f4-88e5-44c4-8b74-3c0e006dd81c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.574486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c81be3f4-88e5-44c4-8b74-3c0e006dd81c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.575236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c81be3f4-88e5-44c4-8b74-3c0e006dd81c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.575697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c81be3f4-88e5-44c4-8b74-3c0e006dd81c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.603951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c81be3f4-88e5-44c4-8b74-3c0e006dd81c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040607 Jun 17 12:57:54.604495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 530/929] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:55.434627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.435302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.442578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.443050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.443849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.444292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.582168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:55.590452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-557a6363-e9fb-426f-b600-477b5c4d4c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160140 Jun 17 12:57:55.591025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 531/930] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:55.597346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.598377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.605677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.606120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.606899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.607329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.671175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:55.679755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-57587add-4263-465f-a58a-eed86187c0aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087660 Jun 17 12:57:55.680322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 532/931] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:55.684933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4234d5b-f535-4c06-9866-075641b42854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.685805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b4234d5b-f535-4c06-9866-075641b42854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.691761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4234d5b-f535-4c06-9866-075641b42854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.692214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4234d5b-f535-4c06-9866-075641b42854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.692965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4234d5b-f535-4c06-9866-075641b42854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.693394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4234d5b-f535-4c06-9866-075641b42854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.723285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b4234d5b-f535-4c06-9866-075641b42854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041963 Jun 17 12:57:55.723863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 533/932] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:55.728211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f361e5c9-ef68-4540-b7cf-41773de12f17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.729111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f361e5c9-ef68-4540-b7cf-41773de12f17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.735212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f361e5c9-ef68-4540-b7cf-41773de12f17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.735697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f361e5c9-ef68-4540-b7cf-41773de12f17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.736438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f361e5c9-ef68-4540-b7cf-41773de12f17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.736843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f361e5c9-ef68-4540-b7cf-41773de12f17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.766234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f361e5c9-ef68-4540-b7cf-41773de12f17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041406 Jun 17 12:57:55.766764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 534/933] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:56.611832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:56.613041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:56.621079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.621519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.622277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.622695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.759085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.770575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3ac307d3-b0fa-4efd-94f6-46ef1a6afd72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164491 Jun 17 12:57:56.771303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 535/934] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:56.775761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:56.776333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:56.782938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.783603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.784794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.785217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.846343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.853982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d15e976a-e83c-4e83-85d0-316877fa9bc6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081707 Jun 17 12:57:56.854539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 536/935] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:56 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:56.859020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f286d093-e40c-4f1c-a896-6b5dd731b681 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:56.859958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f286d093-e40c-4f1c-a896-6b5dd731b681 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:56.866220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f286d093-e40c-4f1c-a896-6b5dd731b681 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.866655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f286d093-e40c-4f1c-a896-6b5dd731b681 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.867402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f286d093-e40c-4f1c-a896-6b5dd731b681 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.867871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f286d093-e40c-4f1c-a896-6b5dd731b681 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.891798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:56.896449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f286d093-e40c-4f1c-a896-6b5dd731b681 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040956 Jun 17 12:57:56.896991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 537/936] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:56.901702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9ef52a33-4379-44e3-ad0a-94635001b4c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:56.902574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9ef52a33-4379-44e3-ad0a-94635001b4c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:56.908345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ef52a33-4379-44e3-ad0a-94635001b4c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.908787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ef52a33-4379-44e3-ad0a-94635001b4c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.909600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ef52a33-4379-44e3-ad0a-94635001b4c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.910051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ef52a33-4379-44e3-ad0a-94635001b4c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.939037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9ef52a33-4379-44e3-ad0a-94635001b4c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041050 Jun 17 12:57:56.939624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 538/937] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:57.789012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:57.789738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:57.797205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.797658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.798422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.798853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.944570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:57.953768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b9d87138-dd43-4f1b-b14e-679d7afef9f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168915 Jun 17 12:57:57.954349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 539/938] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:57.958995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:57.959631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:57.965825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.966269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.967031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.967484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.045254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:58.053795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cbc02364-ca7f-4a12-a183-2af5663cb17a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.098446 Jun 17 12:57:58.054371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 540/939] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:57 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:58.059018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bbe52a95-3847-439b-886d-7edf7c931578 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:58.059992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bbe52a95-3847-439b-886d-7edf7c931578 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:58.066589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbe52a95-3847-439b-886d-7edf7c931578 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.067032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbe52a95-3847-439b-886d-7edf7c931578 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.067835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbe52a95-3847-439b-886d-7edf7c931578 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.068266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbe52a95-3847-439b-886d-7edf7c931578 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.100398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bbe52a95-3847-439b-886d-7edf7c931578 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044989 Jun 17 12:57:58.100964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 541/940] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:58.105729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1710039-0cc7-4a1c-af32-861e427d4e55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:58.106667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1710039-0cc7-4a1c-af32-861e427d4e55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:58.114367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1710039-0cc7-4a1c-af32-861e427d4e55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.114815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1710039-0cc7-4a1c-af32-861e427d4e55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.115634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1710039-0cc7-4a1c-af32-861e427d4e55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.116061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1710039-0cc7-4a1c-af32-861e427d4e55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.150124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1710039-0cc7-4a1c-af32-861e427d4e55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048092 Jun 17 12:57:58.150699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 542/941] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:58.975361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:58.976433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:58.986208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.986852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.988079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.988908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.134645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.142450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e21730c3-ee27-4ea9-8c95-9033b44e248c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172613 Jun 17 12:57:59.143009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 543/942] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:59.147408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:59.148038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:59.153920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.154362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.155115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.155581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.217920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.226580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-99084473-80f1-4626-a7da-89138a8e27d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082484 Jun 17 12:57:59.227089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 544/943] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:59 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:59.231783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-98d2610b-8a85-49ef-80c6-a98dde4a06d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:59.232700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-98d2610b-8a85-49ef-80c6-a98dde4a06d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:59.239103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d2610b-8a85-49ef-80c6-a98dde4a06d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.239583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d2610b-8a85-49ef-80c6-a98dde4a06d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.240343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d2610b-8a85-49ef-80c6-a98dde4a06d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.240773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98d2610b-8a85-49ef-80c6-a98dde4a06d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.277032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-98d2610b-8a85-49ef-80c6-a98dde4a06d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048583 Jun 17 12:57:59.277702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 545/944] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:57:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:57:59.282555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-379002f5-8590-4ab9-9f9b-ef7bbda46a34 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:59.283853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-379002f5-8590-4ab9-9f9b-ef7bbda46a34 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:59.290238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-379002f5-8590-4ab9-9f9b-ef7bbda46a34 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.290679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-379002f5-8590-4ab9-9f9b-ef7bbda46a34 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.291459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-379002f5-8590-4ab9-9f9b-ef7bbda46a34 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.291891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-379002f5-8590-4ab9-9f9b-ef7bbda46a34 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.320832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-379002f5-8590-4ab9-9f9b-ef7bbda46a34 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042144 Jun 17 12:57:59.321371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 546/945] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:57:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:00.160195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:00.160864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:00.167871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.168319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.169090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.169520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.314400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:00.322172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e3fdf990-fae1-49bf-a971-7b3905f76490 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166154 Jun 17 12:58:00.322740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 547/946] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:00.327179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:00.327774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:00.334029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.334469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.335235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.335696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.397646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:00.405470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ebb769e-7555-43cd-80af-80e1c82dad3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081789 Jun 17 12:58:00.406018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 548/947] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:00.410544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-509dbbfb-7f28-47da-85ef-8fb52769f6ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:00.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-509dbbfb-7f28-47da-85ef-8fb52769f6ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:00.417320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-509dbbfb-7f28-47da-85ef-8fb52769f6ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.417760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-509dbbfb-7f28-47da-85ef-8fb52769f6ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.418510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-509dbbfb-7f28-47da-85ef-8fb52769f6ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.418932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-509dbbfb-7f28-47da-85ef-8fb52769f6ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.447273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-509dbbfb-7f28-47da-85ef-8fb52769f6ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040246 Jun 17 12:58:00.447865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 549/948] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:00.452568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ac089f73-7327-4e5a-b113-86ca035f6725 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:00.453479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ac089f73-7327-4e5a-b113-86ca035f6725 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:00.459578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac089f73-7327-4e5a-b113-86ca035f6725 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.460021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac089f73-7327-4e5a-b113-86ca035f6725 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.460779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac089f73-7327-4e5a-b113-86ca035f6725 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.461212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac089f73-7327-4e5a-b113-86ca035f6725 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.490138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ac089f73-7327-4e5a-b113-86ca035f6725 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041279 Jun 17 12:58:00.490688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 550/949] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:01.343305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.344360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.352883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.353328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.354081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.354512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.502099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.510320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6f29e4cf-67ee-48a2-adb1-1377c11d3102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173421 Jun 17 12:58:01.510878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 551/950] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:01.515284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.515910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.522003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.522451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.523193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.523648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.587231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.595058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-87b46b35-480f-426e-9cf7-e49a3b1e307d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083148 Jun 17 12:58:01.595649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 552/951] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:01 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:01.600238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-689e9d0b-f7b8-4c82-87bf-e0c4fb2c14ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.601149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-689e9d0b-f7b8-4c82-87bf-e0c4fb2c14ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.606819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-689e9d0b-f7b8-4c82-87bf-e0c4fb2c14ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.607271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-689e9d0b-f7b8-4c82-87bf-e0c4fb2c14ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.608057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-689e9d0b-f7b8-4c82-87bf-e0c4fb2c14ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.608489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-689e9d0b-f7b8-4c82-87bf-e0c4fb2c14ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.637512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-689e9d0b-f7b8-4c82-87bf-e0c4fb2c14ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040868 Jun 17 12:58:01.638057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 553/952] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:01.642486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-76588ca9-5a48-47b5-9576-1f87dad4923c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.643402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-76588ca9-5a48-47b5-9576-1f87dad4923c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.649208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76588ca9-5a48-47b5-9576-1f87dad4923c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.649582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76588ca9-5a48-47b5-9576-1f87dad4923c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.650325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76588ca9-5a48-47b5-9576-1f87dad4923c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.650753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76588ca9-5a48-47b5-9576-1f87dad4923c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.667562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:01.680686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-76588ca9-5a48-47b5-9576-1f87dad4923c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Jun 17 12:58:01.681234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 554/953] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:02.530924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.532060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.543548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.544304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.545558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.546284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.697107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.709080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6d192f25-ea07-4799-a778-85773d8d8b4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.184728 Jun 17 12:58:02.709641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 555/954] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:02.713960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.714685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.720884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.721332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.722083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.722502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.793128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.804918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1b4058ac-e3c6-4f40-983a-3149f007e583 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094014 Jun 17 12:58:02.805671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 556/955] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:02.810234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0d8309c3-1f28-47e4-ac89-c597b73b39a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.811143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d8309c3-1f28-47e4-ac89-c597b73b39a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.817776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8309c3-1f28-47e4-ac89-c597b73b39a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.818230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8309c3-1f28-47e4-ac89-c597b73b39a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.818991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8309c3-1f28-47e4-ac89-c597b73b39a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.819419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8309c3-1f28-47e4-ac89-c597b73b39a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.848713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0d8309c3-1f28-47e4-ac89-c597b73b39a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041797 Jun 17 12:58:02.849260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 557/956] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:02.853671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5240275-aa7d-40a9-91d6-d915042c02b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.854553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5240275-aa7d-40a9-91d6-d915042c02b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.860514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5240275-aa7d-40a9-91d6-d915042c02b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.860973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5240275-aa7d-40a9-91d6-d915042c02b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.861728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5240275-aa7d-40a9-91d6-d915042c02b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.862166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5240275-aa7d-40a9-91d6-d915042c02b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.892319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5240275-aa7d-40a9-91d6-d915042c02b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Jun 17 12:58:02.892982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 558/957] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:03.643640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:03.644705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:03.656686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.657425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.658675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.659424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:13.651814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=73 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:13.679449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=30 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:20.294184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:58:20.295232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 12:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 12:58:48.907993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 12:58:48.910009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 12:58:48.912163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:58:48.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 12:58:48.914205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 409 to user: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:58:48.915182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-acd50ba4-fcbd-47b2-8ff8-9f815b67d09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 409 len: 152 microversion: 2.1 time: 105.333706 Jun 17 12:58:48.915182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 400/958] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 12:57:03 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 152 bytes in 105335 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 12:58:49.022502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:49.023114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:49.029391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.029832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.030591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.031019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.175956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:49.184004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bedd1f32-388e-4c11-b80b-9004972a7a2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.270868 Jun 17 12:58:49.184581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 401/959] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:49.188964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:49.189555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:49.195916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.196363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.197125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.197551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.274399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:49.282483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ccf2c88-40b0-403f-be4e-87a5ac8df365 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096922 Jun 17 12:58:49.283042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 402/960] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:49 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:49.287662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0facbd38-c59e-411b-8261-3bdc072b7d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:49.288645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0facbd38-c59e-411b-8261-3bdc072b7d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:49.294784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0facbd38-c59e-411b-8261-3bdc072b7d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.295234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0facbd38-c59e-411b-8261-3bdc072b7d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.296063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0facbd38-c59e-411b-8261-3bdc072b7d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.296489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0facbd38-c59e-411b-8261-3bdc072b7d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.325828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0facbd38-c59e-411b-8261-3bdc072b7d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041754 Jun 17 12:58:49.326371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 403/961] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:49.330770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-50fee06b-8f78-424f-8438-25ee7a112808 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:49.331731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-50fee06b-8f78-424f-8438-25ee7a112808 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:49.337533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50fee06b-8f78-424f-8438-25ee7a112808 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.337976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50fee06b-8f78-424f-8438-25ee7a112808 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.338728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50fee06b-8f78-424f-8438-25ee7a112808 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.339159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50fee06b-8f78-424f-8438-25ee7a112808 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.367958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-50fee06b-8f78-424f-8438-25ee7a112808 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 Jun 17 12:58:49.368425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 404/962] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:50.205195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:50.206238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:50.218529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.219268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.220576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.221284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.373122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:50.382361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30a63623-c780-483f-9d3d-ebf3133059e4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.184021 Jun 17 12:58:50.382949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 405/963] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:50.387358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:50.387988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:50.393810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.394271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.395032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.395699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.456150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:50.464832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ed89d6e-d400-44c1-b2e7-27c1bfc68b1e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080835 Jun 17 12:58:50.465542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 406/964] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:50.470229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-792322ea-3689-40ac-9f8e-10a14c464c4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:50.471143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-792322ea-3689-40ac-9f8e-10a14c464c4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:50.477426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792322ea-3689-40ac-9f8e-10a14c464c4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.477867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792322ea-3689-40ac-9f8e-10a14c464c4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.478627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792322ea-3689-40ac-9f8e-10a14c464c4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.479090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792322ea-3689-40ac-9f8e-10a14c464c4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.508260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-792322ea-3689-40ac-9f8e-10a14c464c4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041697 Jun 17 12:58:50.508826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 407/965] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:50.513217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a1fbae2c-c94a-4485-b129-3c0ec5b70929 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:50.514104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a1fbae2c-c94a-4485-b129-3c0ec5b70929 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:50.519957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fbae2c-c94a-4485-b129-3c0ec5b70929 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.520402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fbae2c-c94a-4485-b129-3c0ec5b70929 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.521262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fbae2c-c94a-4485-b129-3c0ec5b70929 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.529001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fbae2c-c94a-4485-b129-3c0ec5b70929 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.566257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a1fbae2c-c94a-4485-b129-3c0ec5b70929 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056419 Jun 17 12:58:50.566971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 408/966] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:51.383217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 12:58:51.385396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 12:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 12:58:51.400254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:51.400880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:51.407731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.408168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.408916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.409346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.562190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:51.574106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f84d5331-2cc4-499f-a1fd-017130bc0439 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.177566 Jun 17 12:58:51.574853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 409/967] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:51.580338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:51.581095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:51.587945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.588383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.589145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.589547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.653726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:51.661625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cf54b7ca-aa01-43d1-8435-253f64e268aa tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085593 Jun 17 12:58:51.662180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 410/968] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:51 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:51.666691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e6fa56dc-e4a5-4efc-8c50-76b685781d71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:51.667621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e6fa56dc-e4a5-4efc-8c50-76b685781d71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:51.673482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fa56dc-e4a5-4efc-8c50-76b685781d71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.673920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fa56dc-e4a5-4efc-8c50-76b685781d71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.674670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fa56dc-e4a5-4efc-8c50-76b685781d71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.675094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fa56dc-e4a5-4efc-8c50-76b685781d71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.703696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e6fa56dc-e4a5-4efc-8c50-76b685781d71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040528 Jun 17 12:58:51.704250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 411/969] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:51.708607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9d8deb8-7a3e-4e68-b8e2-b3624116da4b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:51.709479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9d8deb8-7a3e-4e68-b8e2-b3624116da4b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:51.715099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d8deb8-7a3e-4e68-b8e2-b3624116da4b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.715579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d8deb8-7a3e-4e68-b8e2-b3624116da4b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.716318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d8deb8-7a3e-4e68-b8e2-b3624116da4b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:51.716742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d8deb8-7a3e-4e68-b8e2-b3624116da4b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.745171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9d8deb8-7a3e-4e68-b8e2-b3624116da4b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039986 Jun 17 12:58:51.745701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 412/970] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:52.597457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:52.598688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:52.606355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.606844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.607713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.608181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.757145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:52.765383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e5712cd2-876d-4631-80ad-9d92c86b5ab0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.174480 Jun 17 12:58:52.765951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 413/971] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:52.770403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:52.770999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:52.776976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.777433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.778193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.778660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.839532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:52.847258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cb8dc231-7bbd-4912-bd60-e464cd781916 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080375 Jun 17 12:58:52.847988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 414/972] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:52.852449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81083403-bdb3-4c0e-b11b-6a968016fcd6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:52.853350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81083403-bdb3-4c0e-b11b-6a968016fcd6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:52.859194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81083403-bdb3-4c0e-b11b-6a968016fcd6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.859690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81083403-bdb3-4c0e-b11b-6a968016fcd6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.860453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81083403-bdb3-4c0e-b11b-6a968016fcd6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.860879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81083403-bdb3-4c0e-b11b-6a968016fcd6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.890196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81083403-bdb3-4c0e-b11b-6a968016fcd6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041238 Jun 17 12:58:52.890730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 415/973] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:52.895119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-818223c1-3014-4172-ae4d-9af681a5e0de tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:52.896026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-818223c1-3014-4172-ae4d-9af681a5e0de tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:52.901959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-818223c1-3014-4172-ae4d-9af681a5e0de tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.902396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-818223c1-3014-4172-ae4d-9af681a5e0de tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.903138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-818223c1-3014-4172-ae4d-9af681a5e0de tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.903601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-818223c1-3014-4172-ae4d-9af681a5e0de tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.931728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-818223c1-3014-4172-ae4d-9af681a5e0de tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040019 Jun 17 12:58:52.932276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 416/974] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:53.787307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:53.788835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:53.798905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:53.799710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:53.800970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:53.801633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:53.805649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:53.943275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:53.950957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4c0d467-1488-436f-83bb-31849cbcfa30 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170735 Jun 17 12:58:53.951544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 417/975] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:53.956049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:53.956744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:53.962821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:53.963268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:53.964078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:53.964516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.028394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:54.036447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-159844d0-d844-4ca2-a661-993118a1c2e0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083805 Jun 17 12:58:54.037009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 418/976] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:53 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:54.041600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-12a91788-3bc7-4b6a-b206-cd2ddf34105b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:54.042437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-12a91788-3bc7-4b6a-b206-cd2ddf34105b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:54.048271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12a91788-3bc7-4b6a-b206-cd2ddf34105b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.048711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12a91788-3bc7-4b6a-b206-cd2ddf34105b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.049465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12a91788-3bc7-4b6a-b206-cd2ddf34105b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.049893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12a91788-3bc7-4b6a-b206-cd2ddf34105b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.083808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-12a91788-3bc7-4b6a-b206-cd2ddf34105b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Jun 17 12:58:54.084484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 419/977] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:54.089084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bb25da9e-3936-4d25-a515-c24e44aa2e85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:54.090139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bb25da9e-3936-4d25-a515-c24e44aa2e85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:54.096314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb25da9e-3936-4d25-a515-c24e44aa2e85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.096778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb25da9e-3936-4d25-a515-c24e44aa2e85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.097534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb25da9e-3936-4d25-a515-c24e44aa2e85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.097951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb25da9e-3936-4d25-a515-c24e44aa2e85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.130361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bb25da9e-3936-4d25-a515-c24e44aa2e85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Jun 17 12:58:54.130981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 420/978] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:54.973360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:54.974404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:54.981591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.982025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.982772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.983191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.129227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:55.140655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5c506ae1-541c-495b-805d-168abcfb9253 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173684 Jun 17 12:58:55.141460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 421/979] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:55.145986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:55.146612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:55.152804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.153246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.153995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.154428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.224289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:55.236467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-84b75f47-462e-47ef-b284-97cdde9a7ff0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.093708 Jun 17 12:58:55.237251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 422/980] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:55 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:55.242807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5babe093-4aec-46bb-b0c8-c941bb52be79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:55.243719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5babe093-4aec-46bb-b0c8-c941bb52be79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:55.249533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5babe093-4aec-46bb-b0c8-c941bb52be79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.249973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5babe093-4aec-46bb-b0c8-c941bb52be79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.250715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5babe093-4aec-46bb-b0c8-c941bb52be79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.251137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5babe093-4aec-46bb-b0c8-c941bb52be79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.281922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5babe093-4aec-46bb-b0c8-c941bb52be79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043611 Jun 17 12:58:55.282466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 423/981] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:55.287836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dc7497c2-4e07-47de-9853-12ea289ae60e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:55.288729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dc7497c2-4e07-47de-9853-12ea289ae60e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:55.294524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc7497c2-4e07-47de-9853-12ea289ae60e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.294951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc7497c2-4e07-47de-9853-12ea289ae60e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.295721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc7497c2-4e07-47de-9853-12ea289ae60e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.296145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc7497c2-4e07-47de-9853-12ea289ae60e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.327350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dc7497c2-4e07-47de-9853-12ea289ae60e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Jun 17 12:58:55.327935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 424/982] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:56.161694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:56.162698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:56.169864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.170308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.171067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.171526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.311942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:56.320418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c2b302bf-0133-4781-b473-394a3c084955 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165040 Jun 17 12:58:56.320989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 425/983] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:56.325740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:56.326476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:56.332353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.332830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.333676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.334094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.398129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:56.406385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5cbc2ab8-966c-41f9-9809-25ad814f04b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084410 Jun 17 12:58:56.406970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 426/984] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:56 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:56.411726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b3869591-02c3-4f45-88c2-5a3b7577b754 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:56.412943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b3869591-02c3-4f45-88c2-5a3b7577b754 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:56.418916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3869591-02c3-4f45-88c2-5a3b7577b754 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.419467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3869591-02c3-4f45-88c2-5a3b7577b754 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.420227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3869591-02c3-4f45-88c2-5a3b7577b754 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.420652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3869591-02c3-4f45-88c2-5a3b7577b754 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.449921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b3869591-02c3-4f45-88c2-5a3b7577b754 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041875 Jun 17 12:58:56.450467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 427/985] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:56.454879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5316724b-220e-48a4-b614-57ec1b5fd96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:56.455791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5316724b-220e-48a4-b614-57ec1b5fd96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:56.461716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5316724b-220e-48a4-b614-57ec1b5fd96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.462158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5316724b-220e-48a4-b614-57ec1b5fd96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.462903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5316724b-220e-48a4-b614-57ec1b5fd96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.463332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5316724b-220e-48a4-b614-57ec1b5fd96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.493149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5316724b-220e-48a4-b614-57ec1b5fd96b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041728 Jun 17 12:58:56.493729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 428/986] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:57.341764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:57.342875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:57.353732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.354475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.355807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.356529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.504072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:57.515971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ecc5028-924d-495c-995d-2d55f24187df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.180391 Jun 17 12:58:57.516720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 429/987] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:57.521227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:57.522220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:57.528508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.528948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.529737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.530195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.590853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:57.598938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49a30405-6a7d-4916-8dfc-7c48f5bf051a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081243 Jun 17 12:58:57.599526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 430/988] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:57 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:57.604037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-26f97714-3c73-4c68-b9e2-cd7a4f10c1f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:57.604940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-26f97714-3c73-4c68-b9e2-cd7a4f10c1f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:57.610787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f97714-3c73-4c68-b9e2-cd7a4f10c1f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.611253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f97714-3c73-4c68-b9e2-cd7a4f10c1f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.612031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f97714-3c73-4c68-b9e2-cd7a4f10c1f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.612463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f97714-3c73-4c68-b9e2-cd7a4f10c1f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.641885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-26f97714-3c73-4c68-b9e2-cd7a4f10c1f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041366 Jun 17 12:58:57.642459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 431/989] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:57.646808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-22d43593-e72c-4cd9-b44b-5b5096a64a28 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:57.647708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-22d43593-e72c-4cd9-b44b-5b5096a64a28 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:57.653486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22d43593-e72c-4cd9-b44b-5b5096a64a28 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.653927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22d43593-e72c-4cd9-b44b-5b5096a64a28 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.654673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22d43593-e72c-4cd9-b44b-5b5096a64a28 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:57.655104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22d43593-e72c-4cd9-b44b-5b5096a64a28 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:57.683228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-22d43593-e72c-4cd9-b44b-5b5096a64a28 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039833 Jun 17 12:58:57.683798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 432/990] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:58.535909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:58.536916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:58.543945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.544387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.545138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.545565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.685218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:58.688705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:58.694619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bc39e0e7-f61a-4857-b73d-234fdef21c9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165152 Jun 17 12:58:58.695215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 433/991] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:58.699794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:58.700390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:58.706849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.707296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.708097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.708529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.788356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:58.796362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1a603c4-b297-4d43-80e5-f940aada2f37 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.100118 Jun 17 12:58:58.796969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 434/992] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:58 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:58.802305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-17e323aa-39da-4ec2-a7d7-d7548c7c9636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:58.803983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-17e323aa-39da-4ec2-a7d7-d7548c7c9636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:58.810931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17e323aa-39da-4ec2-a7d7-d7548c7c9636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.811388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17e323aa-39da-4ec2-a7d7-d7548c7c9636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.812150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17e323aa-39da-4ec2-a7d7-d7548c7c9636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.812571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17e323aa-39da-4ec2-a7d7-d7548c7c9636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.847326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-17e323aa-39da-4ec2-a7d7-d7548c7c9636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048830 Jun 17 12:58:58.847936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 435/993] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:58.852785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c4ea435-deb2-4bc5-b044-099ba8e922dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:58.853705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c4ea435-deb2-4bc5-b044-099ba8e922dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:58.860788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c4ea435-deb2-4bc5-b044-099ba8e922dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.861414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c4ea435-deb2-4bc5-b044-099ba8e922dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.862583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c4ea435-deb2-4bc5-b044-099ba8e922dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.863149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c4ea435-deb2-4bc5-b044-099ba8e922dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.894755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c4ea435-deb2-4bc5-b044-099ba8e922dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045765 Jun 17 12:58:58.895314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 436/994] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:59.713879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:59.714582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:59.721526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.721972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.722724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.723152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.857566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:59.865576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2bc74842-9d13-4b91-ab9b-a407c926b3d4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.155666 Jun 17 12:58:59.866108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 437/995] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:59 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:59.870842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:59.871462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:59.877325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.877772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.878537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.878972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.939138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:59.947148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dc1892fc-f07a-4b06-9d52-bc66ec67dfa8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080066 Jun 17 12:58:59.947741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 438/996] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:59 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:59.952315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bc796b57-a47f-4237-ad75-51950cf0903f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:59.953217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bc796b57-a47f-4237-ad75-51950cf0903f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:59.959010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc796b57-a47f-4237-ad75-51950cf0903f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.959560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc796b57-a47f-4237-ad75-51950cf0903f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.960258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc796b57-a47f-4237-ad75-51950cf0903f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.960685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc796b57-a47f-4237-ad75-51950cf0903f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.990227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bc796b57-a47f-4237-ad75-51950cf0903f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041333 Jun 17 12:58:59.991098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 439/997] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:58:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:59.996824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cea6e0b7-b44f-4870-9b31-7944352e2456 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:59.997725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cea6e0b7-b44f-4870-9b31-7944352e2456 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:00.003580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea6e0b7-b44f-4870-9b31-7944352e2456 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.004022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea6e0b7-b44f-4870-9b31-7944352e2456 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.004775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea6e0b7-b44f-4870-9b31-7944352e2456 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.005204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea6e0b7-b44f-4870-9b31-7944352e2456 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.034470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cea6e0b7-b44f-4870-9b31-7944352e2456 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042611 Jun 17 12:59:00.035025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 440/998] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:00.321967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 12:59:00.323635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 12:59:00.325197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:59:00.325852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 12:59:00.327058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 409 to user: Cannot 'detach_volume' instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 while it is in vm_state rescued {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:59:00.328022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c2b89778-69d2-4ca1-be17-4a03d50c6db1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 409 len: 152 microversion: 2.1 time: 56.688285 Jun 17 12:59:00.328022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 559/999] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 12:58:03 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 152 bytes in 56690 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 12:59:00.334597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7613a3a9-5f62-4c7a-bff1-6739d7e0858f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:59:00.335132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7613a3a9-5f62-4c7a-bff1-6739d7e0858f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:00.341405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7613a3a9-5f62-4c7a-bff1-6739d7e0858f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.341918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7613a3a9-5f62-4c7a-bff1-6739d7e0858f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.342677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7613a3a9-5f62-4c7a-bff1-6739d7e0858f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.343113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7613a3a9-5f62-4c7a-bff1-6739d7e0858f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.414339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7613a3a9-5f62-4c7a-bff1-6739d7e0858f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/action" status: 202 len: 0 microversion: 2.1 time: 0.083714 Jun 17 12:59:00.415178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 441/1000] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 12:59:00 2022] POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:59:00.426559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:00.427510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:00.434174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.434622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.435471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.435934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.668467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:00.676765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-256ae8fa-fc7b-451f-a1ab-66887363d7e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1724 microversion: 2.1 time: 0.255766 Jun 17 12:59:00.677335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 560/1001] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:00.883915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:00.884597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:00.891401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.891877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.892649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.893090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.963745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:00.964368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:00.970794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.971242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.972056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.972486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:01.032261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:01.040424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be5bb338-5687-4463-a38c-76d754dd25b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.161827 Jun 17 12:59:01.050480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 442/1002] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:01.053052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:01.056016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f4ff0d2b-198d-4a64-9de7-501e97a5cb12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:01.056933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f4ff0d2b-198d-4a64-9de7-501e97a5cb12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:01.061199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e9395573-a4a0-4e71-92b4-d11472618526 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.101353 Jun 17 12:59:01.061765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 561/1003] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:00 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:01.066447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-36ef6922-cedd-44a1-ac84-a2838f5e03ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:01.067104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4ff0d2b-198d-4a64-9de7-501e97a5cb12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:01.067628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-36ef6922-cedd-44a1-ac84-a2838f5e03ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:01.068694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4ff0d2b-198d-4a64-9de7-501e97a5cb12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:01.069963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4ff0d2b-198d-4a64-9de7-501e97a5cb12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:01.071052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4ff0d2b-198d-4a64-9de7-501e97a5cb12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:01.073917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36ef6922-cedd-44a1-ac84-a2838f5e03ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:01.074364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36ef6922-cedd-44a1-ac84-a2838f5e03ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:01.075156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36ef6922-cedd-44a1-ac84-a2838f5e03ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:01.075616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36ef6922-cedd-44a1-ac84-a2838f5e03ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:01.101566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f4ff0d2b-198d-4a64-9de7-501e97a5cb12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049951 Jun 17 12:59:01.102138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 443/1004] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:01.105143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-36ef6922-cedd-44a1-ac84-a2838f5e03ca tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042335 Jun 17 12:59:01.105702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 562/1005] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:01.696298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:01.696885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:01.703735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:01.704120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:01.704873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:01.705303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:01.839188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:01.851413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71ba9796-2d77-4fd2-a16b-315d555222c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1724 microversion: 2.1 time: 0.159608 Jun 17 12:59:01.852236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 444/1006] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:02.058812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:02.059450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:02.066278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.066722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.067521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.067956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.078272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:02.079054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:02.087403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.087900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.088847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.089309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.157901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:02.165757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-26147a29-b0e5-4d71-8578-13e3e1ce6489 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091577 Jun 17 12:59:02.166685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 445/1007] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:02 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:02.171302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-64f57099-6bd1-47be-af41-0fc22b144385 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:02.172240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-64f57099-6bd1-47be-af41-0fc22b144385 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:02.178275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64f57099-6bd1-47be-af41-0fc22b144385 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.178716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64f57099-6bd1-47be-af41-0fc22b144385 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.179519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64f57099-6bd1-47be-af41-0fc22b144385 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.179951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64f57099-6bd1-47be-af41-0fc22b144385 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.208552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-64f57099-6bd1-47be-af41-0fc22b144385 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040822 Jun 17 12:59:02.209202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 446/1008] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:02.211850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:02.214223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ca492a0-c093-4f28-9f5d-816e68151a8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:02.215163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ca492a0-c093-4f28-9f5d-816e68151a8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:02.219629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5c783c9f-6d08-491f-8d9e-97f286ca1af4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164704 Jun 17 12:59:02.220458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 563/1009] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:02.221176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ca492a0-c093-4f28-9f5d-816e68151a8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.221623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ca492a0-c093-4f28-9f5d-816e68151a8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.222379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ca492a0-c093-4f28-9f5d-816e68151a8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.222832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ca492a0-c093-4f28-9f5d-816e68151a8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.252590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ca492a0-c093-4f28-9f5d-816e68151a8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041944 Jun 17 12:59:02.253118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 447/1010] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:02.869910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:02.870524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:02.877301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.877788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.878498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.878917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.030680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:03.041400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8fc55a01-af71-4c2b-a5fe-3bd8468d9bd4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1724 microversion: 2.1 time: 0.175942 Jun 17 12:59:03.042030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 564/1011] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:02 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:03.184816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:03.185622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:03.194759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.195424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.196322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.196945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.222169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-54b036ab-7c12-43ab-807f-17572f685c28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:03.223930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-54b036ab-7c12-43ab-807f-17572f685c28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:03.232046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54b036ab-7c12-43ab-807f-17572f685c28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.232046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54b036ab-7c12-43ab-807f-17572f685c28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.232398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54b036ab-7c12-43ab-807f-17572f685c28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.232934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54b036ab-7c12-43ab-807f-17572f685c28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.270829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-54b036ab-7c12-43ab-807f-17572f685c28 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053800 Jun 17 12:59:03.272378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 565/1012] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:59:03.275847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:03.277260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:03.278022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:03.284821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.286118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9072acdd-1146-4f54-92a6-03cea01886d0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.106607 Jun 17 12:59:03.286553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.287026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 448/1013] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:03 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:03.287544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.288040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.293953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-afaeb975-a2b0-4fc2-be52-d968d1b15779 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:03.294240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-afaeb975-a2b0-4fc2-be52-d968d1b15779 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:03.300705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afaeb975-a2b0-4fc2-be52-d968d1b15779 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.301119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afaeb975-a2b0-4fc2-be52-d968d1b15779 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.301896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afaeb975-a2b0-4fc2-be52-d968d1b15779 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.302306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afaeb975-a2b0-4fc2-be52-d968d1b15779 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.320332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:03.336977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-afaeb975-a2b0-4fc2-be52-d968d1b15779 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Jun 17 12:59:03.349025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 449/1014] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:03.428412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:03.436112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8f02eb31-28df-4c2a-9ae5-7fd84ff10c63 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163026 Jun 17 12:59:03.436667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 566/1015] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:04.059125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:04.060012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:04.063212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:04.068041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.068486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.069256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.069688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.203904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:04.213333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0e9ad3a1-8081-4480-832d-6c5d1cdde889 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1730 microversion: 2.1 time: 0.158723 Jun 17 12:59:04.213885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 450/1016] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:04.231829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-52c1d474-c74d-4c43-a0da-ab3418178a1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:04.232457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-52c1d474-c74d-4c43-a0da-ab3418178a1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:04.239290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52c1d474-c74d-4c43-a0da-ab3418178a1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.239753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52c1d474-c74d-4c43-a0da-ab3418178a1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.241050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52c1d474-c74d-4c43-a0da-ab3418178a1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.241787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52c1d474-c74d-4c43-a0da-ab3418178a1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.285974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-35983aab-079f-47de-b79c-536b574acb5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:04.286902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-35983aab-079f-47de-b79c-536b574acb5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:04.293993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35983aab-079f-47de-b79c-536b574acb5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.294409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35983aab-079f-47de-b79c-536b574acb5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.295169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35983aab-079f-47de-b79c-536b574acb5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.295637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35983aab-079f-47de-b79c-536b574acb5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.327710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-52c1d474-c74d-4c43-a0da-ab3418178a1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100943 Jun 17 12:59:04.327894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-35983aab-079f-47de-b79c-536b574acb5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045812 Jun 17 12:59:04.328278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 567/1017] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 12:59:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:04.328405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 451/1018] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:04.332842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:04.333436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:04.340485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.340926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.341672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.342090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.348042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9758efff-2fe0-46db-9a06-4bf5c335c6a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:04.349117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9758efff-2fe0-46db-9a06-4bf5c335c6a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:04.356659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9758efff-2fe0-46db-9a06-4bf5c335c6a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.357898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9758efff-2fe0-46db-9a06-4bf5c335c6a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.358786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9758efff-2fe0-46db-9a06-4bf5c335c6a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.359313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9758efff-2fe0-46db-9a06-4bf5c335c6a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.392982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9758efff-2fe0-46db-9a06-4bf5c335c6a4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048814 Jun 17 12:59:04.393605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 568/1019] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:59:04.416244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:04.424829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1075b2db-41a5-43e9-a86a-712e0e7eebda tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095452 Jun 17 12:59:04.425521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 452/1020] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:04 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:04.453535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:04.454211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:04.461183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.461729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.462586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.463141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.604059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:04.612157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-320aae5a-6e18-4c39-abea-6291b9ffc50c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162572 Jun 17 12:59:04.612805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 569/1021] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:05.316744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-9c8287af-e74d-4e6e-b7a5-3fc2920f92c1 req-46db63d3-1fc3-45e4-a17c-d679fe51d302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf52b0f3-44a6-4d5c-82fb-e662f185c898", "tag": "0aab43a3-bc7b-4476-a4ce-489abc0ff452"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:59:05.325295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-9c8287af-e74d-4e6e-b7a5-3fc2920f92c1 req-46db63d3-1fc3-45e4-a17c-d679fe51d302 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.325802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-9c8287af-e74d-4e6e-b7a5-3fc2920f92c1 req-46db63d3-1fc3-45e4-a17c-d679fe51d302 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.337586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-9c8287af-e74d-4e6e-b7a5-3fc2920f92c1 req-46db63d3-1fc3-45e4-a17c-d679fe51d302 service nova] Creating event network-changed:0aab43a3-bc7b-4476-a4ce-489abc0ff452 for instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 on hv-cinder-84617 Jun 17 12:59:05.339916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-acca60fc-f7de-4025-a085-d61612c146b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:05.340843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-acca60fc-f7de-4025-a085-d61612c146b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:05.342850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-9c8287af-e74d-4e6e-b7a5-3fc2920f92c1 req-46db63d3-1fc3-45e4-a17c-d679fe51d302 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091345 Jun 17 12:59:05.343876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 453/1022] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:05.347730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acca60fc-f7de-4025-a085-d61612c146b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.348167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acca60fc-f7de-4025-a085-d61612c146b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.348923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acca60fc-f7de-4025-a085-d61612c146b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.349408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acca60fc-f7de-4025-a085-d61612c146b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.385147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-acca60fc-f7de-4025-a085-d61612c146b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049219 Jun 17 12:59:05.386013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 570/1023] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:05.405296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-464f2568-e01f-4327-bfb2-feb9207ebf0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:05.406308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-464f2568-e01f-4327-bfb2-feb9207ebf0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:05.413144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-464f2568-e01f-4327-bfb2-feb9207ebf0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.413586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-464f2568-e01f-4327-bfb2-feb9207ebf0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.414384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-464f2568-e01f-4327-bfb2-feb9207ebf0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.414810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-464f2568-e01f-4327-bfb2-feb9207ebf0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.445639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:05.446259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:05.447631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-464f2568-e01f-4327-bfb2-feb9207ebf0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 Jun 17 12:59:05.451727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 454/1024] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:59:05.453512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.454262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.454731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.455160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.526183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:05.534226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-283b4474-46c6-4d34-bf3b-685c1ae0466a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095661 Jun 17 12:59:05.535047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 571/1025] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:05 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:05.630697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:05.631526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:05.638400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.638847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.641285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:05.641285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:05.778807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:05.789716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9b4a9088-1ada-4d95-bd47-dad7ac10f954 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162844 Jun 17 12:59:05.791194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 455/1026] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:06.400111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bcd57faa-e04e-4c49-bfab-62e7a90c2030 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:06.400979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bcd57faa-e04e-4c49-bfab-62e7a90c2030 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:06.409339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bcd57faa-e04e-4c49-bfab-62e7a90c2030 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.409859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bcd57faa-e04e-4c49-bfab-62e7a90c2030 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.410638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bcd57faa-e04e-4c49-bfab-62e7a90c2030 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.411067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bcd57faa-e04e-4c49-bfab-62e7a90c2030 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.441207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bcd57faa-e04e-4c49-bfab-62e7a90c2030 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046628 Jun 17 12:59:06.441764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 572/1027] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:06.459918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-74f25a42-3a78-4778-99a6-f6c1e020bee7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:06.460927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-74f25a42-3a78-4778-99a6-f6c1e020bee7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:06.468016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f25a42-3a78-4778-99a6-f6c1e020bee7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.468463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f25a42-3a78-4778-99a6-f6c1e020bee7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.469195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f25a42-3a78-4778-99a6-f6c1e020bee7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.469651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f25a42-3a78-4778-99a6-f6c1e020bee7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.501202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-74f25a42-3a78-4778-99a6-f6c1e020bee7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Jun 17 12:59:06.501772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 456/1028] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:06.551702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:06.552311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:06.558666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.559103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.559880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.560305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.624374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:06.632820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4479fcb3-ebbe-400c-a102-f2b8ed6205ce tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085036 Jun 17 12:59:06.633376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 573/1029] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:06 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:06.811806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:06.812892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:06.821904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.822359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.823118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.823599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.965175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:06.977392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-396bf815-2ca3-44dc-9851-84aab97a4c11 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172179 Jun 17 12:59:06.977951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 457/1030] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:07.364587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-88c37a86-58cc-474a-b5ff-df85b3d6d722 req-9af37ca3-dc4f-4709-a295-791da641fb9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf52b0f3-44a6-4d5c-82fb-e662f185c898", "tag": "0aab43a3-bc7b-4476-a4ce-489abc0ff452"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:59:07.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-88c37a86-58cc-474a-b5ff-df85b3d6d722 req-9af37ca3-dc4f-4709-a295-791da641fb9a service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.374851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-88c37a86-58cc-474a-b5ff-df85b3d6d722 req-9af37ca3-dc4f-4709-a295-791da641fb9a service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.386351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-88c37a86-58cc-474a-b5ff-df85b3d6d722 req-9af37ca3-dc4f-4709-a295-791da641fb9a service nova] Creating event network-changed:0aab43a3-bc7b-4476-a4ce-489abc0ff452 for instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 on hv-cinder-84617 Jun 17 12:59:07.391517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-88c37a86-58cc-474a-b5ff-df85b3d6d722 req-9af37ca3-dc4f-4709-a295-791da641fb9a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033173 Jun 17 12:59:07.392081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 574/1031] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 12:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:07.454539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef27ebb4-305a-4660-a9af-34faf8f6aa2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.455513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef27ebb4-305a-4660-a9af-34faf8f6aa2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:07.461945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef27ebb4-305a-4660-a9af-34faf8f6aa2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.462538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef27ebb4-305a-4660-a9af-34faf8f6aa2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.463122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef27ebb4-305a-4660-a9af-34faf8f6aa2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.463624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef27ebb4-305a-4660-a9af-34faf8f6aa2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.496425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef27ebb4-305a-4660-a9af-34faf8f6aa2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045864 Jun 17 12:59:07.497194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 458/1032] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:07.514238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-81911e21-c354-42fb-b51e-d82d7e1d55fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.515413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-81911e21-c354-42fb-b51e-d82d7e1d55fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:07.522031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81911e21-c354-42fb-b51e-d82d7e1d55fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.522478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81911e21-c354-42fb-b51e-d82d7e1d55fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.523225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81911e21-c354-42fb-b51e-d82d7e1d55fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.523688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81911e21-c354-42fb-b51e-d82d7e1d55fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.553505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-81911e21-c354-42fb-b51e-d82d7e1d55fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Jun 17 12:59:07.554011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 575/1033] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:07.651842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.652446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:07.659029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.659609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.660357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.660816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.722243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:07.730836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-084494c5-2ee1-44f7-9cd9-ac97bfbf9a67 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083870 Jun 17 12:59:07.731398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 459/1034] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:07.994466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.995123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:08.002083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.002533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.003294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.003757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.147065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:08.159116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2a46d44c-efca-4602-b6f4-64cf9949c2ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168743 Jun 17 12:59:08.159996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 576/1035] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:08.513232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-89433aa8-0cd8-4078-b5fb-8277c1d3ec22 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:08.514847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-89433aa8-0cd8-4078-b5fb-8277c1d3ec22 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:08.524864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89433aa8-0cd8-4078-b5fb-8277c1d3ec22 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.525321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89433aa8-0cd8-4078-b5fb-8277c1d3ec22 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.526089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89433aa8-0cd8-4078-b5fb-8277c1d3ec22 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.526519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89433aa8-0cd8-4078-b5fb-8277c1d3ec22 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.556663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-89433aa8-0cd8-4078-b5fb-8277c1d3ec22 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050550 Jun 17 12:59:08.557195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 460/1036] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:08.572216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d797533f-2e4e-48ba-852a-d779cad4cb43 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:08.573737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d797533f-2e4e-48ba-852a-d779cad4cb43 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:08.582980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d797533f-2e4e-48ba-852a-d779cad4cb43 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.583767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d797533f-2e4e-48ba-852a-d779cad4cb43 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.584984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d797533f-2e4e-48ba-852a-d779cad4cb43 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.585909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d797533f-2e4e-48ba-852a-d779cad4cb43 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.589712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:08.620591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d797533f-2e4e-48ba-852a-d779cad4cb43 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056405 Jun 17 12:59:08.621179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 577/1037] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:08.752334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:08.753313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:08.764312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.764944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.766185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.767013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.829961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:08.838095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-154b344f-b59a-4bee-86b3-89ed42a0c230 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092324 Jun 17 12:59:08.838661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 461/1038] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:08 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:09.178216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:09.178863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:09.186087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.186533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.187291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.187754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.328956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:09.337263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0af69dcb-9af1-4d96-b19a-b3ec55dda7e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162945 Jun 17 12:59:09.337831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 578/1039] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:09 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:09.577539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bca085c3-8fcb-4999-a62e-518d3402dc68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:09.579081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bca085c3-8fcb-4999-a62e-518d3402dc68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:09.588347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bca085c3-8fcb-4999-a62e-518d3402dc68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.588792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bca085c3-8fcb-4999-a62e-518d3402dc68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.589556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bca085c3-8fcb-4999-a62e-518d3402dc68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.589981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bca085c3-8fcb-4999-a62e-518d3402dc68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.619656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bca085c3-8fcb-4999-a62e-518d3402dc68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048835 Jun 17 12:59:09.620246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 462/1040] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:59:09.632907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c0c8827f-8a55-433b-ab4e-a7892dc5440d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:09.633834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c0c8827f-8a55-433b-ab4e-a7892dc5440d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:09.640392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0c8827f-8a55-433b-ab4e-a7892dc5440d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.640829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0c8827f-8a55-433b-ab4e-a7892dc5440d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.641580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0c8827f-8a55-433b-ab4e-a7892dc5440d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.642001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0c8827f-8a55-433b-ab4e-a7892dc5440d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.672905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c0c8827f-8a55-433b-ab4e-a7892dc5440d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044361 Jun 17 12:59:09.673420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 579/1041] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:09.858425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:09.859280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:09.870513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.871241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.872545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.873247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.938915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:09.947716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dd74c87e-d60b-4daf-a004-6ecf0df4fe80 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095735 Jun 17 12:59:09.948276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 463/1042] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:09 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:10.360117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:10.360834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:10.369225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.369825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.370644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.371158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.509939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:10.517665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5a42c2e2-f1d2-486e-a831-e1e88d49abf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162213 Jun 17 12:59:10.518250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 580/1043] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:10 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:10.634875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08dafe97-b4e1-4cd6-a531-096792525e6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:10.635749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08dafe97-b4e1-4cd6-a531-096792525e6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:10.642780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08dafe97-b4e1-4cd6-a531-096792525e6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.643204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08dafe97-b4e1-4cd6-a531-096792525e6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.644002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08dafe97-b4e1-4cd6-a531-096792525e6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.644428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08dafe97-b4e1-4cd6-a531-096792525e6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.675159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08dafe97-b4e1-4cd6-a531-096792525e6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046383 Jun 17 12:59:10.675754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 464/1044] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:10.686355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-762ec79e-14bd-4075-89e6-fc936e885317 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:10.687283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-762ec79e-14bd-4075-89e6-fc936e885317 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:10.695724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-762ec79e-14bd-4075-89e6-fc936e885317 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.696130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-762ec79e-14bd-4075-89e6-fc936e885317 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.696887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-762ec79e-14bd-4075-89e6-fc936e885317 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.697317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-762ec79e-14bd-4075-89e6-fc936e885317 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.730841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-762ec79e-14bd-4075-89e6-fc936e885317 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048450 Jun 17 12:59:10.731396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 581/1045] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:10.965821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:10.966379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:10.973272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.973734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.974512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:10.974960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.050825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:11.060501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b9e0f4a7-20b0-4d4a-8431-a860731c7c1c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.099526 Jun 17 12:59:11.061066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 465/1046] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:10 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:11.539432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:11.540462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:11.551625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.552371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.553636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.554358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.687446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-56618b79-ab79-45fa-8172-523d7f90cbeb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:11.688397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-56618b79-ab79-45fa-8172-523d7f90cbeb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:11.692656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:11.697492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56618b79-ab79-45fa-8172-523d7f90cbeb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.698143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56618b79-ab79-45fa-8172-523d7f90cbeb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.699425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56618b79-ab79-45fa-8172-523d7f90cbeb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.700074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-56618b79-ab79-45fa-8172-523d7f90cbeb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.704231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4122de11-f963-4909-a3ce-ebf3e932c321 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170888 Jun 17 12:59:11.704987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 582/1047] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:11.726803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:11.731446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-56618b79-ab79-45fa-8172-523d7f90cbeb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048094 Jun 17 12:59:11.731995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 466/1048] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:11.742228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-72d3ef46-472d-4321-95ff-e43c67f703af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:11.743715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-72d3ef46-472d-4321-95ff-e43c67f703af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:11.749902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72d3ef46-472d-4321-95ff-e43c67f703af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.750362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72d3ef46-472d-4321-95ff-e43c67f703af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.751116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72d3ef46-472d-4321-95ff-e43c67f703af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.751572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72d3ef46-472d-4321-95ff-e43c67f703af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.781660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-72d3ef46-472d-4321-95ff-e43c67f703af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Jun 17 12:59:11.782195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 583/1049] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:12.077821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:12.078446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:12.084742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.085200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.085960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.086396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.147804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:12.155945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-58d5ef14-a938-4149-9c1f-ef819cacc1bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082487 Jun 17 12:59:12.156479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 467/1050] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:12 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:12.725298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:12.726338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:12.733968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.734408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.735154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.735664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.742247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fad5fedf-529e-49d6-acca-1ccd24e07d75 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:12.743182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fad5fedf-529e-49d6-acca-1ccd24e07d75 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:12.750539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fad5fedf-529e-49d6-acca-1ccd24e07d75 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.750988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fad5fedf-529e-49d6-acca-1ccd24e07d75 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.751789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fad5fedf-529e-49d6-acca-1ccd24e07d75 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.752219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fad5fedf-529e-49d6-acca-1ccd24e07d75 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.782163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fad5fedf-529e-49d6-acca-1ccd24e07d75 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043814 Jun 17 12:59:12.783077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 468/1051] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:12.793889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d7338576-cd4b-4890-afc2-ac5f25b98974 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:12.794797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d7338576-cd4b-4890-afc2-ac5f25b98974 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:12.800761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7338576-cd4b-4890-afc2-ac5f25b98974 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.801201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7338576-cd4b-4890-afc2-ac5f25b98974 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.801960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7338576-cd4b-4890-afc2-ac5f25b98974 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.802397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7338576-cd4b-4890-afc2-ac5f25b98974 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.832599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d7338576-cd4b-4890-afc2-ac5f25b98974 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 Jun 17 12:59:12.833168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 469/1052] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:59:12.870826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:12.878756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4a85e8d7-640a-4e50-b8e4-03a10ea57204 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160017 Jun 17 12:59:12.879296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 584/1053] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:13.173157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:13.173801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:13.180707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.181181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.181949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.182381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.242965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:13.251851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4f5b387e-2518-4bcf-9242-57273a37f182 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082600 Jun 17 12:59:13.252421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 470/1054] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:13 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:13.798717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e15f7805-9015-4e50-8e2f-afcf864ed38e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:13.800250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e15f7805-9015-4e50-8e2f-afcf864ed38e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:13.809211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e15f7805-9015-4e50-8e2f-afcf864ed38e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.809661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e15f7805-9015-4e50-8e2f-afcf864ed38e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.810415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e15f7805-9015-4e50-8e2f-afcf864ed38e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.810841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e15f7805-9015-4e50-8e2f-afcf864ed38e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.841404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e15f7805-9015-4e50-8e2f-afcf864ed38e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049397 Jun 17 12:59:13.841946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 585/1055] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:13.844028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bda34c31-cec2-4b3a-97cd-d5a2fecea6a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:13.844979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bda34c31-cec2-4b3a-97cd-d5a2fecea6a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:13.851782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda34c31-cec2-4b3a-97cd-d5a2fecea6a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.852348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda34c31-cec2-4b3a-97cd-d5a2fecea6a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.853251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda34c31-cec2-4b3a-97cd-d5a2fecea6a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.853660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bda34c31-cec2-4b3a-97cd-d5a2fecea6a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.883314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bda34c31-cec2-4b3a-97cd-d5a2fecea6a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Jun 17 12:59:13.883963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 471/1056] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:13.896204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:13.896811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:13.903415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.903846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.904600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.905036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.039759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:14.048038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-284d087b-7fe4-407f-b7ef-5097610814f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.155665 Jun 17 12:59:14.048605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 586/1057] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:14.273245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:14.274403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:14.285143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.285891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.287126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.287887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.350211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:14.358754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3eea7c81-c66b-49e9-aef2-9d6426823ad0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092135 Jun 17 12:59:14.359313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 472/1058] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:14 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:14.856094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f6ee28d-6af8-46c7-a60d-c7b115d0348d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:14.857073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f6ee28d-6af8-46c7-a60d-c7b115d0348d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:14.864337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f6ee28d-6af8-46c7-a60d-c7b115d0348d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.864807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f6ee28d-6af8-46c7-a60d-c7b115d0348d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.865604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f6ee28d-6af8-46c7-a60d-c7b115d0348d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.866054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f6ee28d-6af8-46c7-a60d-c7b115d0348d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.895274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2db2b647-2964-484d-b418-b0bce396a669 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:14.896317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2db2b647-2964-484d-b418-b0bce396a669 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:14.896736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f6ee28d-6af8-46c7-a60d-c7b115d0348d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045633 Jun 17 12:59:14.897299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 587/1059] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:14.904363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2db2b647-2964-484d-b418-b0bce396a669 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.904977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2db2b647-2964-484d-b418-b0bce396a669 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.906115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2db2b647-2964-484d-b418-b0bce396a669 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.906745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2db2b647-2964-484d-b418-b0bce396a669 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.939161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2db2b647-2964-484d-b418-b0bce396a669 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047800 Jun 17 12:59:14.939779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 473/1060] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:15.066246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:15.067032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:15.075024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.075506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.076265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.076697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.216170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:15.229396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9537e3b4-b372-4808-ba8c-b61aca6ec0f4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167199 Jun 17 12:59:15.230162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 588/1061] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:15.379661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:15.380608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:15.391069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.391862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.393106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.393835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.461119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:15.469209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-26f5b409-0d01-40a9-ac10-ef787f102b56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096175 Jun 17 12:59:15.469777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 474/1062] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:15 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:15.913132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-83ee2789-e73d-48c2-b250-8d2bee63d5df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:15.914916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-83ee2789-e73d-48c2-b250-8d2bee63d5df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:15.921830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83ee2789-e73d-48c2-b250-8d2bee63d5df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.922278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83ee2789-e73d-48c2-b250-8d2bee63d5df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.923023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83ee2789-e73d-48c2-b250-8d2bee63d5df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.923512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83ee2789-e73d-48c2-b250-8d2bee63d5df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.951089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-24a6d486-56d1-457f-9211-464980e0b08a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:15.952089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-24a6d486-56d1-457f-9211-464980e0b08a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:15.953548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-83ee2789-e73d-48c2-b250-8d2bee63d5df tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047227 Jun 17 12:59:15.954445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 589/1063] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:15.958931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24a6d486-56d1-457f-9211-464980e0b08a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.959403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24a6d486-56d1-457f-9211-464980e0b08a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.960174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24a6d486-56d1-457f-9211-464980e0b08a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.960618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24a6d486-56d1-457f-9211-464980e0b08a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.990834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-24a6d486-56d1-457f-9211-464980e0b08a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Jun 17 12:59:15.991399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 475/1064] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:16.253809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:16.254608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:16.263635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:16.264195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:16.265149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:16.265695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:16.406274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:16.416765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a41a4f3-5917-42a5-83de-ee6077ff2459 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168224 Jun 17 12:59:16.417467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 590/1065] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:16.489246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:16.490227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:16.501443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:16.502181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:16.503442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:16.504300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:16.570795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:16.578899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-168f7f70-d499-4902-a580-2318c7923d48 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096030 Jun 17 12:59:16.579674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 476/1066] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:16 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:16.969083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-18a407df-830b-45a6-9d20-4ed487b9c181 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:16.970206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-18a407df-830b-45a6-9d20-4ed487b9c181 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:16.979767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18a407df-830b-45a6-9d20-4ed487b9c181 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:16.980351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18a407df-830b-45a6-9d20-4ed487b9c181 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:16.981351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18a407df-830b-45a6-9d20-4ed487b9c181 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:16.981917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18a407df-830b-45a6-9d20-4ed487b9c181 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.002955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7eefd55e-114e-4bac-b32a-6adfbd0de4bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:17.003906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7eefd55e-114e-4bac-b32a-6adfbd0de4bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:17.010847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7eefd55e-114e-4bac-b32a-6adfbd0de4bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.011294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7eefd55e-114e-4bac-b32a-6adfbd0de4bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.012091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7eefd55e-114e-4bac-b32a-6adfbd0de4bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.012518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7eefd55e-114e-4bac-b32a-6adfbd0de4bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.015758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-18a407df-830b-45a6-9d20-4ed487b9c181 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052798 Jun 17 12:59:17.016315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 591/1067] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:17.046638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7eefd55e-114e-4bac-b32a-6adfbd0de4bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047321 Jun 17 12:59:17.047210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 477/1068] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:17.436093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:17.436843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:17.444565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.445091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.445979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.446488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.591012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:17.598954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-154be789-3091-4562-9d9c-c13053725fe2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167785 Jun 17 12:59:17.599540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 592/1069] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:17.601208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:17.601790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:17.608098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.608540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.609313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.609748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.671943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:17.680035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c3a18bb0-e02f-4571-9066-a1b7ab857bad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082777 Jun 17 12:59:17.680619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 478/1070] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:17 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:18.029323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-31832fe9-b1d9-4557-865f-3833c8bf3cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.030390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-31832fe9-b1d9-4557-865f-3833c8bf3cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:18.038637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31832fe9-b1d9-4557-865f-3833c8bf3cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.039164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31832fe9-b1d9-4557-865f-3833c8bf3cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.040143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31832fe9-b1d9-4557-865f-3833c8bf3cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.040858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31832fe9-b1d9-4557-865f-3833c8bf3cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.058788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fbf2ca96-11c0-4341-97b4-6b28665f8a31 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.059757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fbf2ca96-11c0-4341-97b4-6b28665f8a31 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:18.067066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca96-11c0-4341-97b4-6b28665f8a31 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.067243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:18.067593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca96-11c0-4341-97b4-6b28665f8a31 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.068412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca96-11c0-4341-97b4-6b28665f8a31 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.068857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca96-11c0-4341-97b4-6b28665f8a31 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.072357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-31832fe9-b1d9-4557-865f-3833c8bf3cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048105 Jun 17 12:59:18.073344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 593/1071] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:18.099539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fbf2ca96-11c0-4341-97b4-6b28665f8a31 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Jun 17 12:59:18.100098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 479/1072] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:18.621652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.622637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:18.633838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.634812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.635691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.636118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.698239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.698965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:18.705247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.705697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.706459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.706890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.769939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:18.778365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3434faee-2854-4523-b128-0b4d52f20019 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084121 Jun 17 12:59:18.778946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 480/1073] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:18 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:18.783678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:18.792161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a301bac-0e1a-4003-8e88-90eb59f9edb6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.178282 Jun 17 12:59:18.792709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 594/1074] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:19.089559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9ef772c0-8d74-446e-95cf-e495aa980529 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:19.090679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9ef772c0-8d74-446e-95cf-e495aa980529 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:19.099074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ef772c0-8d74-446e-95cf-e495aa980529 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.099679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ef772c0-8d74-446e-95cf-e495aa980529 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.100608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ef772c0-8d74-446e-95cf-e495aa980529 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.101136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ef772c0-8d74-446e-95cf-e495aa980529 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.112683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f9cca5c6-c06c-415a-93f6-462cc5c86686 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:19.114579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f9cca5c6-c06c-415a-93f6-462cc5c86686 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:19.123482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9cca5c6-c06c-415a-93f6-462cc5c86686 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.123927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9cca5c6-c06c-415a-93f6-462cc5c86686 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.124687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9cca5c6-c06c-415a-93f6-462cc5c86686 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.125111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9cca5c6-c06c-415a-93f6-462cc5c86686 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.136132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9ef772c0-8d74-446e-95cf-e495aa980529 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053760 Jun 17 12:59:19.136726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 481/1075] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:19.156522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f9cca5c6-c06c-415a-93f6-462cc5c86686 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048734 Jun 17 12:59:19.156796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 595/1076] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:19.799440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:19.800522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:19.809485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.809928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.810693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.810940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:19.811260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.811593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:19.817821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.818268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.819024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.819482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.876397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:19.884359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c8e702ae-97d4-4269-80d1-25302610d9a6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091470 Jun 17 12:59:19.885026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 482/1077] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:19 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:19.952769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:19.960488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6fa73ee7-1719-4a5a-95c4-5aa6dbe0fc77 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.153371 Jun 17 12:59:19.961019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 596/1078] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:20.148641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2676e480-8b04-4020-b207-97997ef43f8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:20.149558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2676e480-8b04-4020-b207-97997ef43f8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:20.158105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2676e480-8b04-4020-b207-97997ef43f8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.158762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2676e480-8b04-4020-b207-97997ef43f8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.159847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2676e480-8b04-4020-b207-97997ef43f8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.160282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2676e480-8b04-4020-b207-97997ef43f8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.168574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b8d197ea-4495-4d96-8cc5-2a5c81577998 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:20.169510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b8d197ea-4495-4d96-8cc5-2a5c81577998 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:20.176530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d197ea-4495-4d96-8cc5-2a5c81577998 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.176978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d197ea-4495-4d96-8cc5-2a5c81577998 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.177742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d197ea-4495-4d96-8cc5-2a5c81577998 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.178167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d197ea-4495-4d96-8cc5-2a5c81577998 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.182822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:20.198956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2676e480-8b04-4020-b207-97997ef43f8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054247 Jun 17 12:59:20.199785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 483/1079] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:20.209268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b8d197ea-4495-4d96-8cc5-2a5c81577998 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Jun 17 12:59:20.209829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 597/1080] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:20.903909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:20.904506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:20.913468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.914143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.915421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.916226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.980439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:20.981047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:20.987763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.988219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.988987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.989422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:21.139938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:21.147844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0e3c5aca-fee0-4143-87ab-47165bb480ca tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172702 Jun 17 12:59:21.148405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 598/1081] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:20 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:21.199599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:21.208474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3cd57b42-3809-437c-8d83-6bc41ff5af55 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.310308 Jun 17 12:59:21.209219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 484/1082] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:20 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:21.211425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-82f4260f-004f-478c-bb6e-5d5c2d4b2618 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:21.212354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-82f4260f-004f-478c-bb6e-5d5c2d4b2618 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:21.219700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82f4260f-004f-478c-bb6e-5d5c2d4b2618 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:21.220394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82f4260f-004f-478c-bb6e-5d5c2d4b2618 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:21.220999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7bf8cfc7-8e5e-4480-b982-1e8b5badf5c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:21.221161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82f4260f-004f-478c-bb6e-5d5c2d4b2618 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:21.221592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82f4260f-004f-478c-bb6e-5d5c2d4b2618 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:21.221915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7bf8cfc7-8e5e-4480-b982-1e8b5badf5c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:21.228788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bf8cfc7-8e5e-4480-b982-1e8b5badf5c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:21.229356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bf8cfc7-8e5e-4480-b982-1e8b5badf5c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:21.230223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bf8cfc7-8e5e-4480-b982-1e8b5badf5c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:21.230650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7bf8cfc7-8e5e-4480-b982-1e8b5badf5c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:21.255063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-82f4260f-004f-478c-bb6e-5d5c2d4b2618 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048012 Jun 17 12:59:21.255914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 599/1083] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:59:21.262089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7bf8cfc7-8e5e-4480-b982-1e8b5badf5c6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Jun 17 12:59:21.262702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 485/1084] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:22.165643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:22.166256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:22.172818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.173281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.174032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.174466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.226250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:22.226869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:22.234314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.234755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.235553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.235984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.298740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:22.306575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9daea5e-074e-4901-8e5f-a269aebdf56f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084153 Jun 17 12:59:22.307249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 486/1085] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:22 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:22.312049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c9d9fed-6178-469a-9787-3f1dfe7632e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:22.313110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5c9d9fed-6178-469a-9787-3f1dfe7632e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:22.319146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c9d9fed-6178-469a-9787-3f1dfe7632e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.319613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c9d9fed-6178-469a-9787-3f1dfe7632e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.319948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:22.320415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c9d9fed-6178-469a-9787-3f1dfe7632e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.320793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c9d9fed-6178-469a-9787-3f1dfe7632e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.328714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1a53f7a6-37ad-488d-ad35-75538fc73dff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167062 Jun 17 12:59:22.329309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 600/1086] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:22.333901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1981f617-79a2-472a-990b-595ff0bd6c64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:22.334814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1981f617-79a2-472a-990b-595ff0bd6c64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:22.342097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1981f617-79a2-472a-990b-595ff0bd6c64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.342532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1981f617-79a2-472a-990b-595ff0bd6c64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.343286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1981f617-79a2-472a-990b-595ff0bd6c64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.343733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1981f617-79a2-472a-990b-595ff0bd6c64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.350998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5c9d9fed-6178-469a-9787-3f1dfe7632e4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042652 Jun 17 12:59:22.351606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 487/1087] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:22.373705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1981f617-79a2-472a-990b-595ff0bd6c64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Jun 17 12:59:22.374155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 601/1088] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:23.326861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:23.327551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:23.335730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.336271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.337116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.337608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.347577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:23.348285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:23.356989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.357926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.358707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.359143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.405110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:23.412774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-661f57f7-1bc1-4656-809e-edfb138f5226 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092121 Jun 17 12:59:23.413562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 488/1089] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:23 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:23.418435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-acb0d1d0-b438-439c-810b-7ea3708b3d85 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:23.419831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-acb0d1d0-b438-439c-810b-7ea3708b3d85 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:23.425734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acb0d1d0-b438-439c-810b-7ea3708b3d85 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.426171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acb0d1d0-b438-439c-810b-7ea3708b3d85 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.426948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acb0d1d0-b438-439c-810b-7ea3708b3d85 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.427422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acb0d1d0-b438-439c-810b-7ea3708b3d85 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.463446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-acb0d1d0-b438-439c-810b-7ea3708b3d85 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049048 Jun 17 12:59:23.464224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 489/1090] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:23.469290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-73cf5e38-dde7-4efb-b160-f3190690670d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:23.470193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-73cf5e38-dde7-4efb-b160-f3190690670d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:23.476207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73cf5e38-dde7-4efb-b160-f3190690670d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.476636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73cf5e38-dde7-4efb-b160-f3190690670d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.477379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73cf5e38-dde7-4efb-b160-f3190690670d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:23.477802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73cf5e38-dde7-4efb-b160-f3190690670d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:23.497427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:23.505094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5072740b-e0ad-42fc-812c-2c2a860b5959 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162444 Jun 17 12:59:23.505641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 602/1091] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:23.507790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-73cf5e38-dde7-4efb-b160-f3190690670d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042741 Jun 17 12:59:23.508336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 490/1092] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:24.433546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:24.434499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:24.436901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=87 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:24.442729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.443170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.443967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.444390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.475544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a53023c9-83d1-4fab-9e0f-e261ae8b040f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:24.476545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a53023c9-83d1-4fab-9e0f-e261ae8b040f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:24.483769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53023c9-83d1-4fab-9e0f-e261ae8b040f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.484285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53023c9-83d1-4fab-9e0f-e261ae8b040f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.485105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53023c9-83d1-4fab-9e0f-e261ae8b040f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.485596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53023c9-83d1-4fab-9e0f-e261ae8b040f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.506295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:24.514175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a481b469-0c12-4da7-9527-90d50ce80229 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087333 Jun 17 12:59:24.514954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 603/1093] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:24 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:24.519399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8975e30d-44be-4ff1-bd07-c9f0e9bbdfe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:24.520349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8975e30d-44be-4ff1-bd07-c9f0e9bbdfe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:24.524738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a53023c9-83d1-4fab-9e0f-e261ae8b040f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053172 Jun 17 12:59:24.525315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 491/1094] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:24.526506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8975e30d-44be-4ff1-bd07-c9f0e9bbdfe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.526950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8975e30d-44be-4ff1-bd07-c9f0e9bbdfe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.527775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8975e30d-44be-4ff1-bd07-c9f0e9bbdfe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.528199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8975e30d-44be-4ff1-bd07-c9f0e9bbdfe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.530291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:24.530884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:24.537065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.537499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.538244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.538665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.557626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8975e30d-44be-4ff1-bd07-c9f0e9bbdfe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Jun 17 12:59:24.558181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 604/1095] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:24.675331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:24.683631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b9cabe1a-4ac3-49f8-9ea6-65c686779f47 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.157221 Jun 17 12:59:24.684129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 492/1096] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:25.534885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:25.535809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:25.540374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bee96d3c-397f-4e3a-ac96-e3417df90e42 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:25.542025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bee96d3c-397f-4e3a-ac96-e3417df90e42 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:25.546212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.546212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.550180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.550180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.551604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee96d3c-397f-4e3a-ac96-e3417df90e42 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.552113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee96d3c-397f-4e3a-ac96-e3417df90e42 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.552893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee96d3c-397f-4e3a-ac96-e3417df90e42 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.553326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee96d3c-397f-4e3a-ac96-e3417df90e42 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.584397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bee96d3c-397f-4e3a-ac96-e3417df90e42 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050261 Jun 17 12:59:25.584964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 493/1097] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:25.589602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-28bf4083-ff6f-428b-b71b-33062b55e8f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:25.590727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-28bf4083-ff6f-428b-b71b-33062b55e8f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:25.596876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28bf4083-ff6f-428b-b71b-33062b55e8f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.597316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28bf4083-ff6f-428b-b71b-33062b55e8f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.598075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28bf4083-ff6f-428b-b71b-33062b55e8f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.598498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28bf4083-ff6f-428b-b71b-33062b55e8f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.614332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:25.622487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-81975701-1aa1-40db-a4d1-c4db0d655244 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094002 Jun 17 12:59:25.623163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 605/1098] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:25 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:25.628175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-28bf4083-ff6f-428b-b71b-33062b55e8f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 Jun 17 12:59:25.628734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 494/1099] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:25.705494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:25.706496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:25.716660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.717105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.717872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.718307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.852964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:25.860861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-28884e12-f8ae-44a4-8a66-8be0d16cc753 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162088 Jun 17 12:59:25.861432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 606/1100] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:26.598373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-934c9f31-68d8-49a0-b18f-2815d1515496 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:26.599493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-934c9f31-68d8-49a0-b18f-2815d1515496 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:26.607295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-934c9f31-68d8-49a0-b18f-2815d1515496 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.607808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-934c9f31-68d8-49a0-b18f-2815d1515496 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.609828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-934c9f31-68d8-49a0-b18f-2815d1515496 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.609828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-934c9f31-68d8-49a0-b18f-2815d1515496 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.640239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:26.640683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:26.643275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-934c9f31-68d8-49a0-b18f-2815d1515496 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049328 Jun 17 12:59:26.643891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 495/1101] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:26 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:26.648403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e15c409a-163e-4397-b174-fbb6ef466c65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:26.649295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e15c409a-163e-4397-b174-fbb6ef466c65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:26.650647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.651096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.651896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.652324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.655640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e15c409a-163e-4397-b174-fbb6ef466c65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.656108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e15c409a-163e-4397-b174-fbb6ef466c65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.656913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e15c409a-163e-4397-b174-fbb6ef466c65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.657269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e15c409a-163e-4397-b174-fbb6ef466c65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.686929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e15c409a-163e-4397-b174-fbb6ef466c65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Jun 17 12:59:26.687511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 496/1102] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:26.714100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:26.722134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-82175873-eb7d-4565-854c-8de726c43df2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086372 Jun 17 12:59:26.722723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 607/1103] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:26 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:26.882955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:26.883995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:26.892748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.893191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.893951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.894383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.035035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:27.043160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2d8dbe68-09ac-4927-b0c6-81abffabfd64 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166576 Jun 17 12:59:27.043764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 497/1104] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:27.659071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fded5625-c62a-4aa2-b2cf-7ea0f383947a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:27.660238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fded5625-c62a-4aa2-b2cf-7ea0f383947a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:27.671215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fded5625-c62a-4aa2-b2cf-7ea0f383947a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.671671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fded5625-c62a-4aa2-b2cf-7ea0f383947a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.672433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fded5625-c62a-4aa2-b2cf-7ea0f383947a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.672861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fded5625-c62a-4aa2-b2cf-7ea0f383947a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.698480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30330ae3-1c19-4ae1-9a29-bfa66401e238 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:27.699534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30330ae3-1c19-4ae1-9a29-bfa66401e238 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:27.703836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fded5625-c62a-4aa2-b2cf-7ea0f383947a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051028 Jun 17 12:59:27.704404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 608/1105] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:27.707189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30330ae3-1c19-4ae1-9a29-bfa66401e238 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.707661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30330ae3-1c19-4ae1-9a29-bfa66401e238 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.708413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30330ae3-1c19-4ae1-9a29-bfa66401e238 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.708832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30330ae3-1c19-4ae1-9a29-bfa66401e238 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.738096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:27.738606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:27.738882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30330ae3-1c19-4ae1-9a29-bfa66401e238 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Jun 17 12:59:27.739443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 498/1106] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:27.745028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.745465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.746218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.746640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.809791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:27.817883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d4f83f58-37d5-4b51-b370-c8488f7a1c20 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083704 Jun 17 12:59:27.818452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 609/1107] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:27 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:28.064504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:28.065315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:28.073658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.074240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.075222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.075832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.213414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:28.221191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ab7ee3ae-431d-468b-a873-bec923daeb6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162538 Jun 17 12:59:28.221762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 499/1108] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:28.719426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fca9108c-74c3-4e3e-85d6-9d512d794d04 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:28.720487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fca9108c-74c3-4e3e-85d6-9d512d794d04 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:28.728667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fca9108c-74c3-4e3e-85d6-9d512d794d04 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.729225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fca9108c-74c3-4e3e-85d6-9d512d794d04 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.730119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fca9108c-74c3-4e3e-85d6-9d512d794d04 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.730627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fca9108c-74c3-4e3e-85d6-9d512d794d04 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.751462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:28.751696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1c789d94-e98d-411f-8682-e6832824c457 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:28.752725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1c789d94-e98d-411f-8682-e6832824c457 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:28.756239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:28.760426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c789d94-e98d-411f-8682-e6832824c457 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.760868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c789d94-e98d-411f-8682-e6832824c457 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.761633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c789d94-e98d-411f-8682-e6832824c457 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.762068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c789d94-e98d-411f-8682-e6832824c457 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.765585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fca9108c-74c3-4e3e-85d6-9d512d794d04 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052728 Jun 17 12:59:28.765783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:28.766495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 610/1109] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:28.794600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1c789d94-e98d-411f-8682-e6832824c457 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Jun 17 12:59:28.795117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 500/1110] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:28.841932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:28.842541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:28.849118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.849573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.850337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.850799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.922461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:28.930772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0fc52843-57af-4679-b9dc-41a9652982fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092817 Jun 17 12:59:28.931346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 611/1111] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:28 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:29.242418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:29.243445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:29.254564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.255318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.256642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.257364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.399892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:29.409999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1603400d-b1a5-447f-ba8a-5331b506dd5c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.174016 Jun 17 12:59:29.410563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 501/1112] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:29.782064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2ca33fef-5966-4735-a37d-a3b5176bb115 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:29.783592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2ca33fef-5966-4735-a37d-a3b5176bb115 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:29.794637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ca33fef-5966-4735-a37d-a3b5176bb115 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.795410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ca33fef-5966-4735-a37d-a3b5176bb115 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.796545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ca33fef-5966-4735-a37d-a3b5176bb115 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.796970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ca33fef-5966-4735-a37d-a3b5176bb115 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.806275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cb5c0165-81ca-4029-96f7-841ef643c492 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:29.807214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cb5c0165-81ca-4029-96f7-841ef643c492 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:29.814120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb5c0165-81ca-4029-96f7-841ef643c492 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.814567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb5c0165-81ca-4029-96f7-841ef643c492 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.815326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb5c0165-81ca-4029-96f7-841ef643c492 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.815786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb5c0165-81ca-4029-96f7-841ef643c492 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.826610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2ca33fef-5966-4735-a37d-a3b5176bb115 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051318 Jun 17 12:59:29.827163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 612/1113] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:29.845284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cb5c0165-81ca-4029-96f7-841ef643c492 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042921 Jun 17 12:59:29.845839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 502/1114] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:29.951449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:29.952619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:29.959580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.960051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.960851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:29.961310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.024726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:30.033208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48a59854-b01e-423a-aecc-893697178ace tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088116 Jun 17 12:59:30.033706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 613/1115] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:29 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:30.431930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:30.432803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:30.440981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.441562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.442356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.442782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.585351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:30.593525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-39f182d4-839b-4cc8-b160-25dbe4c6c20b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168348 Jun 17 12:59:30.594120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 503/1116] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:30 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:30.843099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6c55812f-34cb-4a95-a1f6-182d9d6057cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:30.844348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6c55812f-34cb-4a95-a1f6-182d9d6057cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:30.852682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c55812f-34cb-4a95-a1f6-182d9d6057cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.853170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c55812f-34cb-4a95-a1f6-182d9d6057cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.854010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c55812f-34cb-4a95-a1f6-182d9d6057cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.854480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c55812f-34cb-4a95-a1f6-182d9d6057cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.857487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-167f87ea-8c35-4812-a0d0-9563535d35e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:30.858544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-167f87ea-8c35-4812-a0d0-9563535d35e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:30.866033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-167f87ea-8c35-4812-a0d0-9563535d35e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.866530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-167f87ea-8c35-4812-a0d0-9563535d35e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.867364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-167f87ea-8c35-4812-a0d0-9563535d35e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.867868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-167f87ea-8c35-4812-a0d0-9563535d35e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.887495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6c55812f-34cb-4a95-a1f6-182d9d6057cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051170 Jun 17 12:59:30.888297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 614/1117] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:30.899972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-167f87ea-8c35-4812-a0d0-9563535d35e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Jun 17 12:59:30.900524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 504/1118] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:31.054407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.055443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:31.065731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.066538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.067340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.067796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.133058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:31.141147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7823008f-0b82-463d-bbe8-9cc6f5bd0f4a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.093644 Jun 17 12:59:31.141690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 615/1119] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:31 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:31.611025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.611913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:31.619207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.620214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.621086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.621696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.764160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:31.776221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e7ad6b2d-95ac-417d-b75e-4d173a29a4a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168838 Jun 17 12:59:31.776993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 505/1120] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:31.906571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-726a56a7-72d6-41f1-acb0-eebbb9f457f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.908018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-726a56a7-72d6-41f1-acb0-eebbb9f457f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:31.916179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-50c7c667-882d-4a4a-b1a1-9de9574a23df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.917650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-50c7c667-882d-4a4a-b1a1-9de9574a23df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:31.919161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-726a56a7-72d6-41f1-acb0-eebbb9f457f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.919951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-726a56a7-72d6-41f1-acb0-eebbb9f457f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.921203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-726a56a7-72d6-41f1-acb0-eebbb9f457f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.921923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-726a56a7-72d6-41f1-acb0-eebbb9f457f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.927855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50c7c667-882d-4a4a-b1a1-9de9574a23df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.928288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50c7c667-882d-4a4a-b1a1-9de9574a23df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.929045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50c7c667-882d-4a4a-b1a1-9de9574a23df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.929458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50c7c667-882d-4a4a-b1a1-9de9574a23df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.953539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-726a56a7-72d6-41f1-acb0-eebbb9f457f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053924 Jun 17 12:59:31.954129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 616/1121] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:31.959595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-50c7c667-882d-4a4a-b1a1-9de9574a23df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050701 Jun 17 12:59:31.960157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 506/1122] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:32.158111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:32.158630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:32.165555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.166008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.166754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.167176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.233113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:32.241127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a3168a1-f9ad-4abc-bb7f-2d971585599c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087033 Jun 17 12:59:32.241691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 617/1123] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:32 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:32.801026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:32.801776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:32.809502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.810027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.810920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.811462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.944109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:32.952056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6cbfa53c-0368-4219-ad2d-f8c73f9026e8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.157641 Jun 17 12:59:32.952623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 507/1124] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:32.967969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-677b6239-9fa3-43a9-82cb-b05748df1ad8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:32.969273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-677b6239-9fa3-43a9-82cb-b05748df1ad8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:32.973766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d42adfe0-3316-4f3c-8458-f5500a723161 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:32.974695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d42adfe0-3316-4f3c-8458-f5500a723161 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:32.977702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677b6239-9fa3-43a9-82cb-b05748df1ad8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.978173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677b6239-9fa3-43a9-82cb-b05748df1ad8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.978944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677b6239-9fa3-43a9-82cb-b05748df1ad8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.979415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-677b6239-9fa3-43a9-82cb-b05748df1ad8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.981742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d42adfe0-3316-4f3c-8458-f5500a723161 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.982175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d42adfe0-3316-4f3c-8458-f5500a723161 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.982915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d42adfe0-3316-4f3c-8458-f5500a723161 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.983338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d42adfe0-3316-4f3c-8458-f5500a723161 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:33.010391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-677b6239-9fa3-43a9-82cb-b05748df1ad8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048488 Jun 17 12:59:33.010961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 618/1125] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:33.014143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d42adfe0-3316-4f3c-8458-f5500a723161 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046247 Jun 17 12:59:33.014697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 508/1126] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:33.266191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:33.267189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:33.277497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:33.278240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:33.279499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:33.280263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:33.344552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:33.353256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2c0d12d2-05cc-49a9-aade-f5efe62e8e92 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.093655 Jun 17 12:59:33.353822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 619/1127] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:33 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:33.973965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:33.974787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:33.983932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:33.984524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:33.985518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:33.986084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.022673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-240e8a38-3061-4fd8-ba5d-ad6e4634eee0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:34.023651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-240e8a38-3061-4fd8-ba5d-ad6e4634eee0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:34.030632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-240e8a38-3061-4fd8-ba5d-ad6e4634eee0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.031084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-240e8a38-3061-4fd8-ba5d-ad6e4634eee0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.031886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-240e8a38-3061-4fd8-ba5d-ad6e4634eee0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.032315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-240e8a38-3061-4fd8-ba5d-ad6e4634eee0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.062820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-240e8a38-3061-4fd8-ba5d-ad6e4634eee0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044275 Jun 17 12:59:34.063354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 620/1128] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:34.068177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-10bcf636-dcd8-40ab-aed7-bd65257494bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:34.069095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-10bcf636-dcd8-40ab-aed7-bd65257494bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:34.075850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10bcf636-dcd8-40ab-aed7-bd65257494bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.076299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10bcf636-dcd8-40ab-aed7-bd65257494bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.077067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10bcf636-dcd8-40ab-aed7-bd65257494bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.077482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10bcf636-dcd8-40ab-aed7-bd65257494bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.107149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-10bcf636-dcd8-40ab-aed7-bd65257494bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042699 Jun 17 12:59:34.108091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 621/1129] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:34.126128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:34.134107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1e4d2817-dc74-4c3b-a13e-fa154be6c22b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166934 Jun 17 12:59:34.134671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 509/1130] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:34.374983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:34.376025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:34.386420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.387159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.388479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.389200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.454817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:34.463582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a0e690cf-b0b7-48f7-abc1-91fac41e4f56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095716 Jun 17 12:59:34.464145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 622/1131] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:34 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:35.077862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-feb631b3-aa27-4af4-9905-6b396996226f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:35.079114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-feb631b3-aa27-4af4-9905-6b396996226f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:35.087513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feb631b3-aa27-4af4-9905-6b396996226f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.087986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feb631b3-aa27-4af4-9905-6b396996226f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.088735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feb631b3-aa27-4af4-9905-6b396996226f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.089157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feb631b3-aa27-4af4-9905-6b396996226f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.120306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-83c908e0-5453-4c14-b6b2-268d05941739 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:35.120783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-feb631b3-aa27-4af4-9905-6b396996226f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048634 Jun 17 12:59:35.121254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 510/1132] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:35.121822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-83c908e0-5453-4c14-b6b2-268d05941739 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:35.128947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83c908e0-5453-4c14-b6b2-268d05941739 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.129344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83c908e0-5453-4c14-b6b2-268d05941739 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.130163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83c908e0-5453-4c14-b6b2-268d05941739 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.130595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83c908e0-5453-4c14-b6b2-268d05941739 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.151618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:35.152207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:35.158308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.158743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.159496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.159943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.161775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-83c908e0-5453-4c14-b6b2-268d05941739 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047118 Jun 17 12:59:35.162345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 623/1133] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:35.292940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:35.304376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5860769d-63ed-4bec-8d00-1a82f4299386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.156310 Jun 17 12:59:35.305155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 511/1134] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:35.485079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:35.485948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:35.496729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.497473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.498729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:35.499462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:35.565007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:35.574309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-51ec9f89-0bd6-4d6f-a8b5-acf6b680e05f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096099 Jun 17 12:59:35.574876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 624/1135] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:35 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:36.134057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-62c0fdbc-bc58-44a7-9641-ed16a86834a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:36.134983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-62c0fdbc-bc58-44a7-9641-ed16a86834a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:36.142237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c0fdbc-bc58-44a7-9641-ed16a86834a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.142684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c0fdbc-bc58-44a7-9641-ed16a86834a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.143485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c0fdbc-bc58-44a7-9641-ed16a86834a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.143923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62c0fdbc-bc58-44a7-9641-ed16a86834a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.173461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-96101e8d-a3e4-4c79-92ca-b09d176f8bd0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:36.174414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-96101e8d-a3e4-4c79-92ca-b09d176f8bd0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:36.176263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-62c0fdbc-bc58-44a7-9641-ed16a86834a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045891 Jun 17 12:59:36.176647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 512/1136] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:36.182141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96101e8d-a3e4-4c79-92ca-b09d176f8bd0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.182598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96101e8d-a3e4-4c79-92ca-b09d176f8bd0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.183808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96101e8d-a3e4-4c79-92ca-b09d176f8bd0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.184309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96101e8d-a3e4-4c79-92ca-b09d176f8bd0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.217225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-96101e8d-a3e4-4c79-92ca-b09d176f8bd0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047816 Jun 17 12:59:36.217774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 625/1137] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:36.325623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:36.326238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:36.332731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.333183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.334162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.334633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.475912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:36.484495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-25ceb0b8-c4f1-4ed4-b09d-f686ed94b320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162701 Jun 17 12:59:36.485039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 513/1138] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:36.595416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:36.596415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:36.606629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.607319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.608455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.609022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.675281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:36.683591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9ba225f0-314a-4b6c-b047-73a659fc8191 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094703 Jun 17 12:59:36.684156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 626/1139] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:36 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:37.187543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fb6dc6af-1ab1-49a6-9bb4-180060125962 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:37.188461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fb6dc6af-1ab1-49a6-9bb4-180060125962 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:37.201877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb6dc6af-1ab1-49a6-9bb4-180060125962 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.202327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb6dc6af-1ab1-49a6-9bb4-180060125962 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.203092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb6dc6af-1ab1-49a6-9bb4-180060125962 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.203558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb6dc6af-1ab1-49a6-9bb4-180060125962 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.229569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-61c938e9-08b8-4cd2-aaaa-01ae83206536 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:37.230494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-61c938e9-08b8-4cd2-aaaa-01ae83206536 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:37.236189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fb6dc6af-1ab1-49a6-9bb4-180060125962 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052702 Jun 17 12:59:37.236759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 514/1140] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:37.237493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61c938e9-08b8-4cd2-aaaa-01ae83206536 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.237936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61c938e9-08b8-4cd2-aaaa-01ae83206536 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.238939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61c938e9-08b8-4cd2-aaaa-01ae83206536 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.239391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61c938e9-08b8-4cd2-aaaa-01ae83206536 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.243519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:37.270334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-61c938e9-08b8-4cd2-aaaa-01ae83206536 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Jun 17 12:59:37.270882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 627/1141] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:37.504512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:37.505114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:37.516306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.516749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.517521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.517952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.663034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:37.670621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d3ce3799-eb08-427d-8e03-71fe76ea9325 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.171017 Jun 17 12:59:37.671188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 515/1142] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:37.700510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:37.701112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:37.708150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.708590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.709341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.709765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.006380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:38.018167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3301061e-cf62-411f-b644-74a830291cee tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.321239 Jun 17 12:59:38.019012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 628/1143] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:37 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:38.252174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5727e185-5d55-4f2b-abc5-3a4883e97a17 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:38.253560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5727e185-5d55-4f2b-abc5-3a4883e97a17 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:38.260603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5727e185-5d55-4f2b-abc5-3a4883e97a17 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.261071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5727e185-5d55-4f2b-abc5-3a4883e97a17 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.261825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5727e185-5d55-4f2b-abc5-3a4883e97a17 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.262255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5727e185-5d55-4f2b-abc5-3a4883e97a17 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.281791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c617f341-20c1-43a1-b621-52373356429c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:38.282821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c617f341-20c1-43a1-b621-52373356429c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:38.289087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:38.290263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c617f341-20c1-43a1-b621-52373356429c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.290820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c617f341-20c1-43a1-b621-52373356429c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.291925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c617f341-20c1-43a1-b621-52373356429c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.292399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c617f341-20c1-43a1-b621-52373356429c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.294621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5727e185-5d55-4f2b-abc5-3a4883e97a17 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048188 Jun 17 12:59:38.295472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 516/1144] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:38.326388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c617f341-20c1-43a1-b621-52373356429c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048603 Jun 17 12:59:38.326946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 629/1145] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:38.693606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:38.694637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:38.704790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.705511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.706743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.707634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.841313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:38.852679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f22b33ac-0d39-4708-8a74-f6d1cf866ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166356 Jun 17 12:59:38.857047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 517/1146] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:39.040245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:39.041274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:39.052903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.053679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.054887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.055638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.123748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:39.132008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47509e61-30f3-45d7-a3f7-30edc7affb4d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.098843 Jun 17 12:59:39.132567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 630/1147] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:39 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:39.311133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f9edf315-8e53-4d91-8f83-5f8c816f4899 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:39.312668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f9edf315-8e53-4d91-8f83-5f8c816f4899 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:39.321234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9edf315-8e53-4d91-8f83-5f8c816f4899 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.321693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9edf315-8e53-4d91-8f83-5f8c816f4899 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.322456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9edf315-8e53-4d91-8f83-5f8c816f4899 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.322888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9edf315-8e53-4d91-8f83-5f8c816f4899 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.338529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f1c85d2-93cc-435d-bb91-5320d1753c5f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:39.339501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f1c85d2-93cc-435d-bb91-5320d1753c5f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:39.345852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f1c85d2-93cc-435d-bb91-5320d1753c5f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.346306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f1c85d2-93cc-435d-bb91-5320d1753c5f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.347070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f1c85d2-93cc-435d-bb91-5320d1753c5f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.347540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f1c85d2-93cc-435d-bb91-5320d1753c5f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.353190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f9edf315-8e53-4d91-8f83-5f8c816f4899 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048834 Jun 17 12:59:39.353761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 518/1148] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:39.378219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f1c85d2-93cc-435d-bb91-5320d1753c5f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Jun 17 12:59:39.378695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 631/1149] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:39.875020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:39.875720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:39.883003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.883474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.884217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.884643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.025679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:40.033693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d2135128-35b6-4ba4-91f4-23fb11d35865 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163458 Jun 17 12:59:40.034259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 519/1150] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:40.147952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:40.148556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:40.155236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.155716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.156472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.156897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.220244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:40.228135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-322bc898-67ed-49a3-92e6-b08f048c8892 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084366 Jun 17 12:59:40.228803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 632/1151] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:40 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:40.367802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a21c0817-9e13-433d-9dae-b70f4d674fd9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:40.368936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a21c0817-9e13-433d-9dae-b70f4d674fd9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:40.377951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a21c0817-9e13-433d-9dae-b70f4d674fd9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.378505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a21c0817-9e13-433d-9dae-b70f4d674fd9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.379925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a21c0817-9e13-433d-9dae-b70f4d674fd9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.380235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a21c0817-9e13-433d-9dae-b70f4d674fd9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.391614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-639cdae3-59dc-4b1b-81da-df72c5ecfdc1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:40.392657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-639cdae3-59dc-4b1b-81da-df72c5ecfdc1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:40.400215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-639cdae3-59dc-4b1b-81da-df72c5ecfdc1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.400701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-639cdae3-59dc-4b1b-81da-df72c5ecfdc1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.401456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-639cdae3-59dc-4b1b-81da-df72c5ecfdc1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.401875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-639cdae3-59dc-4b1b-81da-df72c5ecfdc1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.414821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a21c0817-9e13-433d-9dae-b70f4d674fd9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053138 Jun 17 12:59:40.415624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 520/1152] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:40.432210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-639cdae3-59dc-4b1b-81da-df72c5ecfdc1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Jun 17 12:59:40.432758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 633/1153] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:41.056130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:41.057120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:41.067433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.068254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.069505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.070220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.215768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:41.224081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-83da6049-40f8-448e-ab90-85d52dacdef4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175222 Jun 17 12:59:41.224645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 521/1154] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:41.248276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:41.249177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:41.258072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.258513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.259264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.259724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.325297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:41.333019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cf50bde7-e6e9-4c59-8c91-396b3bab73d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091476 Jun 17 12:59:41.333611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 634/1155] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:41 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:41.430849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c0058206-fb3d-453c-9f1c-fc3d0c278a9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:41.432450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c0058206-fb3d-453c-9f1c-fc3d0c278a9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:41.443589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0058206-fb3d-453c-9f1c-fc3d0c278a9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.444015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0058206-fb3d-453c-9f1c-fc3d0c278a9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.444769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0058206-fb3d-453c-9f1c-fc3d0c278a9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.445192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0058206-fb3d-453c-9f1c-fc3d0c278a9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.445958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd27fa30-3824-473d-a377-84d046c5d2e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:41.446900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd27fa30-3824-473d-a377-84d046c5d2e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:41.453370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd27fa30-3824-473d-a377-84d046c5d2e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.453818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd27fa30-3824-473d-a377-84d046c5d2e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.454584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd27fa30-3824-473d-a377-84d046c5d2e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:41.455018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd27fa30-3824-473d-a377-84d046c5d2e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.475396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c0058206-fb3d-453c-9f1c-fc3d0c278a9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051356 Jun 17 12:59:41.475963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 522/1156] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:41.484524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd27fa30-3824-473d-a377-84d046c5d2e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Jun 17 12:59:41.485044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 635/1157] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:42.242308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:42.243164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:42.250879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.251339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.252134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.252571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.351004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:42.351598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:42.358655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.359116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.359929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.360355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.393562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:42.401545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11922912-7de1-49d3-acb5-0ab7289b371a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163822 Jun 17 12:59:42.402148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 523/1158] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:42.423409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:42.432005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d529d578-cf98-4b54-976d-c266c259d4b5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085351 Jun 17 12:59:42.432576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 636/1159] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:42 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:42.488225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b2f346c-3e47-46a5-90e5-a447e4b6728e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:42.489277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b2f346c-3e47-46a5-90e5-a447e4b6728e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:42.496660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b2f346c-3e47-46a5-90e5-a447e4b6728e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.496970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6342000d-0fd4-46b5-84a2-1d7b5ddd7dc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:42.497423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b2f346c-3e47-46a5-90e5-a447e4b6728e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.497855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b2f346c-3e47-46a5-90e5-a447e4b6728e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.497995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6342000d-0fd4-46b5-84a2-1d7b5ddd7dc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:42.498295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b2f346c-3e47-46a5-90e5-a447e4b6728e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.504461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6342000d-0fd4-46b5-84a2-1d7b5ddd7dc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.504913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6342000d-0fd4-46b5-84a2-1d7b5ddd7dc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.505765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6342000d-0fd4-46b5-84a2-1d7b5ddd7dc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:42.506203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6342000d-0fd4-46b5-84a2-1d7b5ddd7dc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:42.531705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b2f346c-3e47-46a5-90e5-a447e4b6728e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047390 Jun 17 12:59:42.532283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 524/1160] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:42.538511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6342000d-0fd4-46b5-84a2-1d7b5ddd7dc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 Jun 17 12:59:42.539301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 637/1161] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:43.419358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:43.419917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:43.426584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.427017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.427834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.428275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.454189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:43.454790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:43.462599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.463046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.463839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.464264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.527748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:43.535584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2af902f9-5a01-4374-96b4-7c4320192041 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085428 Jun 17 12:59:43.543280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 638/1162] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:43 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:43.549281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-78805565-7c65-456e-ac57-8bd3f789cf40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:43.550304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-78805565-7c65-456e-ac57-8bd3f789cf40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:43.558217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78805565-7c65-456e-ac57-8bd3f789cf40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.558658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78805565-7c65-456e-ac57-8bd3f789cf40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.559562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78805565-7c65-456e-ac57-8bd3f789cf40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.559873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78805565-7c65-456e-ac57-8bd3f789cf40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.576725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:43.585107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-03d556b0-b7b2-422a-8727-99b8c5bddeea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169879 Jun 17 12:59:43.585689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 525/1163] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:43.590876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2422f859-6334-4eab-8e65-363affe549f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:43.591973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2422f859-6334-4eab-8e65-363affe549f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:43.597154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-78805565-7c65-456e-ac57-8bd3f789cf40 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052689 Jun 17 12:59:43.597939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 639/1164] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:43.598438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2422f859-6334-4eab-8e65-363affe549f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.598886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2422f859-6334-4eab-8e65-363affe549f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.599782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2422f859-6334-4eab-8e65-363affe549f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:43.600217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2422f859-6334-4eab-8e65-363affe549f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:43.643129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2422f859-6334-4eab-8e65-363affe549f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056356 Jun 17 12:59:43.643709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 526/1165] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:44.555939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:44.557013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:44.568359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.568815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.569581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.570017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.601812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:44.602396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:44.610070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.610507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.611273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.611812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.637864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:44.645453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2aa3f3a2-72b2-42d7-b7e4-16f504f698d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096550 Jun 17 12:59:44.646071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 640/1166] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:44 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:44.650713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-565f549c-8e91-487c-ab9f-81ce8eaabe13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:44.651683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-565f549c-8e91-487c-ab9f-81ce8eaabe13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:44.658195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565f549c-8e91-487c-ab9f-81ce8eaabe13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.658637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565f549c-8e91-487c-ab9f-81ce8eaabe13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.659435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565f549c-8e91-487c-ab9f-81ce8eaabe13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.659872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565f549c-8e91-487c-ab9f-81ce8eaabe13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.689743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-565f549c-8e91-487c-ab9f-81ce8eaabe13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042593 Jun 17 12:59:44.690284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 641/1167] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:44.697326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e54f410b-a7b4-43f4-904d-3b830e3d06a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:44.698248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e54f410b-a7b4-43f4-904d-3b830e3d06a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:44.704393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e54f410b-a7b4-43f4-904d-3b830e3d06a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.704836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e54f410b-a7b4-43f4-904d-3b830e3d06a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.705599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e54f410b-a7b4-43f4-904d-3b830e3d06a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:44.706031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e54f410b-a7b4-43f4-904d-3b830e3d06a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:44.735914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e54f410b-a7b4-43f4-904d-3b830e3d06a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Jun 17 12:59:44.736472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 642/1168] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:44.748936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:44.756948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-19213deb-bf8a-442a-9df6-ad3a8d0678fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.159102 Jun 17 12:59:44.757503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 527/1169] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:45.667993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:45.668946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:45.679022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.679511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.680255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.680706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.701623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b274ae37-7f78-4f2b-9ef4-3020dd61ce9e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:45.702568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b274ae37-7f78-4f2b-9ef4-3020dd61ce9e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:45.709731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b274ae37-7f78-4f2b-9ef4-3020dd61ce9e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.710179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b274ae37-7f78-4f2b-9ef4-3020dd61ce9e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.710935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b274ae37-7f78-4f2b-9ef4-3020dd61ce9e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.711385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b274ae37-7f78-4f2b-9ef4-3020dd61ce9e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.740739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b274ae37-7f78-4f2b-9ef4-3020dd61ce9e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043042 Jun 17 12:59:45.741265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 528/1170] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:45.746831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:45.747020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d6749aa4-620a-4b92-9d59-84eeba59a7fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:45.747797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d6749aa4-620a-4b92-9d59-84eeba59a7fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:45.750335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:45.754049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6749aa4-620a-4b92-9d59-84eeba59a7fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.754492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6749aa4-620a-4b92-9d59-84eeba59a7fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.755325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6749aa4-620a-4b92-9d59-84eeba59a7fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.755624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2e5ce6e3-0523-4ab5-a1a3-7e4fa57c6a94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094158 Jun 17 12:59:45.755798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6749aa4-620a-4b92-9d59-84eeba59a7fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.756249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 643/1171] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:45 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:45.777932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:45.778536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:45.784665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.784850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d6749aa4-620a-4b92-9d59-84eeba59a7fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Jun 17 12:59:45.785110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.785415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 529/1172] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:45.785868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:45.786330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:45.924577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:45.932813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8aa9d8e1-9d53-4932-973a-71fcf630ac72 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158685 Jun 17 12:59:45.933381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 644/1173] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:46.757158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b20e7c7b-e83c-4a87-92f0-8dc978b496cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:46.758237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b20e7c7b-e83c-4a87-92f0-8dc978b496cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:46.766269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b20e7c7b-e83c-4a87-92f0-8dc978b496cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.766796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b20e7c7b-e83c-4a87-92f0-8dc978b496cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:46.767731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b20e7c7b-e83c-4a87-92f0-8dc978b496cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.768240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b20e7c7b-e83c-4a87-92f0-8dc978b496cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:46.773388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:46.774138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:46.781949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.782469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:46.783389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.783909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:46.801361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b20e7c7b-e83c-4a87-92f0-8dc978b496cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050913 Jun 17 12:59:46.801920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 530/1174] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:46.806632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1948af99-93c6-4c96-85ee-2dad8d95350a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:46.807569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1948af99-93c6-4c96-85ee-2dad8d95350a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:46.813934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1948af99-93c6-4c96-85ee-2dad8d95350a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.814383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1948af99-93c6-4c96-85ee-2dad8d95350a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:46.815166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1948af99-93c6-4c96-85ee-2dad8d95350a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.815643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1948af99-93c6-4c96-85ee-2dad8d95350a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:46.846317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:46.847115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1948af99-93c6-4c96-85ee-2dad8d95350a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Jun 17 12:59:46.847726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 531/1175] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:46.854050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-397f2d0d-a597-498d-8caf-3c03849d5362 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085233 Jun 17 12:59:46.854597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 645/1176] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:46 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:46.953873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:46.954871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:46.962987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.963459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:46.964218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:46.964647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:47.268305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:47.279902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-97388962-7d78-4c84-9c1a-241f69b1ad20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.331976 Jun 17 12:59:47.280747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 532/1177] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:47.817926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a5ad7a3d-844f-4af2-8783-86ee8e8f5985 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:47.819497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a5ad7a3d-844f-4af2-8783-86ee8e8f5985 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:47.831185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5ad7a3d-844f-4af2-8783-86ee8e8f5985 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:47.831942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5ad7a3d-844f-4af2-8783-86ee8e8f5985 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:47.833138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5ad7a3d-844f-4af2-8783-86ee8e8f5985 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:47.833888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5ad7a3d-844f-4af2-8783-86ee8e8f5985 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:47.858642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c1a4dc55-4dc9-4fdb-8329-c008b6479b42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:47.859599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c1a4dc55-4dc9-4fdb-8329-c008b6479b42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:47.864248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a5ad7a3d-844f-4af2-8783-86ee8e8f5985 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053271 Jun 17 12:59:47.865157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 646/1178] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:47.866467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc55-4dc9-4fdb-8329-c008b6479b42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:47.866920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc55-4dc9-4fdb-8329-c008b6479b42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:47.867718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc55-4dc9-4fdb-8329-c008b6479b42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:47.868145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1a4dc55-4dc9-4fdb-8329-c008b6479b42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:47.870145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:47.871107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:47.877151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:47.877591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:47.878360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:47.878795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:47.885523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:47.899405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c1a4dc55-4dc9-4fdb-8329-c008b6479b42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Jun 17 12:59:47.900220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 533/1179] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:47.943405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:47.951245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8c9d449a-1ee7-4faf-87a6-4eb91432fa86 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085123 Jun 17 12:59:47.951827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 647/1180] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:47 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:48.304023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:48.304622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:48.311322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.311795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:48.312554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.312984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:48.460471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:48.467931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3c08f193-478e-48d3-aaa8-ea72f38b72e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170442 Jun 17 12:59:48.468482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 534/1181] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:48.881760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6b904c6c-f1e0-44c4-b781-90e19852a573 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:48.883119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6b904c6c-f1e0-44c4-b781-90e19852a573 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:48.890590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b904c6c-f1e0-44c4-b781-90e19852a573 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.891066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b904c6c-f1e0-44c4-b781-90e19852a573 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:48.891918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b904c6c-f1e0-44c4-b781-90e19852a573 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.892369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b904c6c-f1e0-44c4-b781-90e19852a573 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:48.911667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11b78599-3bfb-45c6-9f7e-2f75334cac54 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:48.912632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11b78599-3bfb-45c6-9f7e-2f75334cac54 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:48.919685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b78599-3bfb-45c6-9f7e-2f75334cac54 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.920164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b78599-3bfb-45c6-9f7e-2f75334cac54 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:48.920940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b78599-3bfb-45c6-9f7e-2f75334cac54 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.921358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11b78599-3bfb-45c6-9f7e-2f75334cac54 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:48.923227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6b904c6c-f1e0-44c4-b781-90e19852a573 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048325 Jun 17 12:59:48.923814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 648/1182] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:48.951312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11b78599-3bfb-45c6-9f7e-2f75334cac54 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Jun 17 12:59:48.951880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 535/1183] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:48.970007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:48.970609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:48.977164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.977611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:48.978377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:48.978814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.045295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:49.053494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-213172d0-59da-43a6-89cb-c55de6d4dfa0 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087283 Jun 17 12:59:49.054080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 649/1184] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:48 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:49.489356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:49.490222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:49.501343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.502091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.503335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.504116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.640943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:49.653503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d6d17c4f-0aa5-4470-ace5-652bb4e9a659 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170509 Jun 17 12:59:49.654313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 536/1185] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:49.939080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cff7787d-c35d-43e6-a3a6-1dd43105c2c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:49.940604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cff7787d-c35d-43e6-a3a6-1dd43105c2c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:49.952084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff7787d-c35d-43e6-a3a6-1dd43105c2c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.952866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff7787d-c35d-43e6-a3a6-1dd43105c2c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.954192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff7787d-c35d-43e6-a3a6-1dd43105c2c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.954916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff7787d-c35d-43e6-a3a6-1dd43105c2c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.964341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-86ab3aa6-13e4-4ba7-a669-71bd219444d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:49.965298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-86ab3aa6-13e4-4ba7-a669-71bd219444d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:49.972216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86ab3aa6-13e4-4ba7-a669-71bd219444d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.972641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86ab3aa6-13e4-4ba7-a669-71bd219444d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.973371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86ab3aa6-13e4-4ba7-a669-71bd219444d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.973832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86ab3aa6-13e4-4ba7-a669-71bd219444d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.987761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cff7787d-c35d-43e6-a3a6-1dd43105c2c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054814 Jun 17 12:59:49.991467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 650/1186] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:50.005261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-86ab3aa6-13e4-4ba7-a669-71bd219444d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045572 Jun 17 12:59:50.005819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 537/1187] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:50.070386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:50.071058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:50.077652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:50.078117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:50.078882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:50.079313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:50.141809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:50.150192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-16589629-0a69-44de-a02c-ca4b99b4dc3c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083857 Jun 17 12:59:50.150722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 651/1188] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:50.675685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:50.676656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:50.684638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:50.685088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:50.685850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:50.686288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:50.821582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:50.829336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-23f6bd6e-ef7d-4d08-90fd-5b7e4453d295 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160287 Jun 17 12:59:50.829904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 538/1189] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:51.003731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9999e880-61a3-4a92-a283-3f470b4baaf7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:51.005252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9999e880-61a3-4a92-a283-3f470b4baaf7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:51.014563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9999e880-61a3-4a92-a283-3f470b4baaf7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.015000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9999e880-61a3-4a92-a283-3f470b4baaf7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.015823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9999e880-61a3-4a92-a283-3f470b4baaf7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.016321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9999e880-61a3-4a92-a283-3f470b4baaf7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.017230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ec0ea1c5-f0df-4a9a-b7db-0c15c853551b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:51.018240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ec0ea1c5-f0df-4a9a-b7db-0c15c853551b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:51.025240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec0ea1c5-f0df-4a9a-b7db-0c15c853551b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.025689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec0ea1c5-f0df-4a9a-b7db-0c15c853551b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.026462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec0ea1c5-f0df-4a9a-b7db-0c15c853551b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.026931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec0ea1c5-f0df-4a9a-b7db-0c15c853551b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.046956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9999e880-61a3-4a92-a283-3f470b4baaf7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050014 Jun 17 12:59:51.047541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 652/1190] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:51.056260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ec0ea1c5-f0df-4a9a-b7db-0c15c853551b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Jun 17 12:59:51.056815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 539/1191] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:51.178817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:51.179957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:51.182875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:51.192246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.192979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.194305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.195062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.259016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:51.267060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-abe3a1b0-133c-46b2-b57d-e71142382bc7 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.097790 Jun 17 12:59:51.267653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 653/1192] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:51 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:51.848613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:51.849368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:51.860139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.860775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.861971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.862629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.006569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:52.016966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-163046ec-dd52-4c4e-a637-22d82fb63e38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.174078 Jun 17 12:59:52.017525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 540/1193] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:52.058845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-44e00938-729a-4041-861f-f53b699641ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:52.059744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-44e00938-729a-4041-861f-f53b699641ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:52.066376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44e00938-729a-4041-861f-f53b699641ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.066833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44e00938-729a-4041-861f-f53b699641ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.067606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44e00938-729a-4041-861f-f53b699641ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.068034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44e00938-729a-4041-861f-f53b699641ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.068607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d2813241-19de-4677-acb3-a4438174e805 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:52.069547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d2813241-19de-4677-acb3-a4438174e805 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:52.076344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2813241-19de-4677-acb3-a4438174e805 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.076791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2813241-19de-4677-acb3-a4438174e805 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.077562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2813241-19de-4677-acb3-a4438174e805 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.077991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2813241-19de-4677-acb3-a4438174e805 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.097276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-44e00938-729a-4041-861f-f53b699641ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042760 Jun 17 12:59:52.097832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 654/1194] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:52.108135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d2813241-19de-4677-acb3-a4438174e805 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 Jun 17 12:59:52.108702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 541/1195] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:52.290277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:52.291143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:52.298006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.298454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.299222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.299690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.364951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:52.373489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4cce5cb7-967f-44a9-94e4-31ea850f72c8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088406 Jun 17 12:59:52.374074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 655/1196] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:53.039562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:53.040488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:53.047593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.048041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.048802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.049243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.109567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-560dc05f-dedd-4221-9499-e39dfa4b35f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:53.110508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-560dc05f-dedd-4221-9499-e39dfa4b35f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:53.119638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-560dc05f-dedd-4221-9499-e39dfa4b35f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.120574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-560dc05f-dedd-4221-9499-e39dfa4b35f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.121688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-560dc05f-dedd-4221-9499-e39dfa4b35f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.122130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-560dc05f-dedd-4221-9499-e39dfa4b35f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.155026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-560dc05f-dedd-4221-9499-e39dfa4b35f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049415 Jun 17 12:59:53.155694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 656/1197] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:59:53.160496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-42c71f95-d354-4cf5-878d-2d1aedf18178 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:53.161425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-42c71f95-d354-4cf5-878d-2d1aedf18178 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:53.167782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42c71f95-d354-4cf5-878d-2d1aedf18178 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.168238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42c71f95-d354-4cf5-878d-2d1aedf18178 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.169017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42c71f95-d354-4cf5-878d-2d1aedf18178 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.169418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42c71f95-d354-4cf5-878d-2d1aedf18178 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.194864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:53.200598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-42c71f95-d354-4cf5-878d-2d1aedf18178 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Jun 17 12:59:53.201198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 657/1198] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:53.202808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0e5f5eff-f5cc-436b-9746-d64f4695399b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169773 Jun 17 12:59:53.203410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 542/1199] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:53.395087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:53.395984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:53.405042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.405607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.406369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.406797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.471007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:53.482310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ab39c372-babc-4104-99f3-467d51e90f97 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094172 Jun 17 12:59:53.483118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 658/1200] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:53 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:54.170261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2d25915c-00d2-4526-b8e8-f3dcb7f458cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:54.171713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2d25915c-00d2-4526-b8e8-f3dcb7f458cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:54.181766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d25915c-00d2-4526-b8e8-f3dcb7f458cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.182908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d25915c-00d2-4526-b8e8-f3dcb7f458cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.183475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d25915c-00d2-4526-b8e8-f3dcb7f458cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.183900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d25915c-00d2-4526-b8e8-f3dcb7f458cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.212982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-697df0e6-cbb8-4ac4-b69e-611dd6afd53a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:54.214141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2d25915c-00d2-4526-b8e8-f3dcb7f458cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049152 Jun 17 12:59:54.214277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-697df0e6-cbb8-4ac4-b69e-611dd6afd53a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:54.214529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 543/1201] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:54.220486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:54.221076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:54.221241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-697df0e6-cbb8-4ac4-b69e-611dd6afd53a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.221685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-697df0e6-cbb8-4ac4-b69e-611dd6afd53a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.222452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-697df0e6-cbb8-4ac4-b69e-611dd6afd53a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.222883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-697df0e6-cbb8-4ac4-b69e-611dd6afd53a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.227349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.227850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.228616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.229061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.252443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-697df0e6-cbb8-4ac4-b69e-611dd6afd53a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Jun 17 12:59:54.253028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 659/1202] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:54.384145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:54.392272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-220354a2-86db-4049-8a9a-131ff542a637 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175538 Jun 17 12:59:54.392808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 544/1203] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:54.504353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:54.505338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:54.513889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.514333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.515085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:54.515564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:54.534153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:54.578677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:54.586855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8e5dfe74-49a8-4170-9d3e-7dfc507eebab tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089092 Jun 17 12:59:54.587428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 660/1204] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:54 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:55.227520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1364380d-ad2c-4395-9dfa-9456780d37e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:55.228651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1364380d-ad2c-4395-9dfa-9456780d37e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:55.235949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1364380d-ad2c-4395-9dfa-9456780d37e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.236398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1364380d-ad2c-4395-9dfa-9456780d37e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.237159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1364380d-ad2c-4395-9dfa-9456780d37e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.237597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1364380d-ad2c-4395-9dfa-9456780d37e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.263580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e87f82c3-26c4-49b4-8ea3-1a6cd3ccf6bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:55.264738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e87f82c3-26c4-49b4-8ea3-1a6cd3ccf6bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:55.268504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1364380d-ad2c-4395-9dfa-9456780d37e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046000 Jun 17 12:59:55.269107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 545/1205] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:55.271397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e87f82c3-26c4-49b4-8ea3-1a6cd3ccf6bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.271868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e87f82c3-26c4-49b4-8ea3-1a6cd3ccf6bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.272630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e87f82c3-26c4-49b4-8ea3-1a6cd3ccf6bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.273054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e87f82c3-26c4-49b4-8ea3-1a6cd3ccf6bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.302790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e87f82c3-26c4-49b4-8ea3-1a6cd3ccf6bf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043317 Jun 17 12:59:55.303340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 661/1206] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:55.414695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:55.415597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:55.426673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.427412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.428728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.429445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.570931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:55.583052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0354dbdb-a33f-4728-86a4-66a5f16058bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175004 Jun 17 12:59:55.583788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 546/1207] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:55.610760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:55.611468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:55.617875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.618322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.619080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.619553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.680821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:55.688905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1125ee25-b21c-4398-87e1-37f1efd06ccf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082052 Jun 17 12:59:55.689466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 662/1208] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:55 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:56.285568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cf27ef49-b334-4b29-bff6-7cc6b7de5e89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:56.287101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cf27ef49-b334-4b29-bff6-7cc6b7de5e89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:56.299119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf27ef49-b334-4b29-bff6-7cc6b7de5e89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.299914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf27ef49-b334-4b29-bff6-7cc6b7de5e89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.301226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf27ef49-b334-4b29-bff6-7cc6b7de5e89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.302086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf27ef49-b334-4b29-bff6-7cc6b7de5e89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.314492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cec1467f-425e-4713-a129-054e4bb5a5d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:56.315520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cec1467f-425e-4713-a129-054e4bb5a5d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:56.321947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cec1467f-425e-4713-a129-054e4bb5a5d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.322359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cec1467f-425e-4713-a129-054e4bb5a5d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.323157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cec1467f-425e-4713-a129-054e4bb5a5d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.323894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cec1467f-425e-4713-a129-054e4bb5a5d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.335646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cf27ef49-b334-4b29-bff6-7cc6b7de5e89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057263 Jun 17 12:59:56.339709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 547/1209] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:56.353458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cec1467f-425e-4713-a129-054e4bb5a5d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 Jun 17 12:59:56.354016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 663/1210] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:56.601565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:56.602159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:56.609068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.609514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.610262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.610689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.705569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:56.706176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:56.712325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.712770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.713548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.713960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.750139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:56.757976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3cbdb15f-3fa4-4615-84b1-060b5259f61b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160424 Jun 17 12:59:56.758738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 548/1211] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:56.782427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:56.790039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d83617f8-c066-4001-97c2-7b70326d7d76 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088447 Jun 17 12:59:56.790603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 664/1212] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:56 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:57.351907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ff5fda46-2c51-4b26-b7a8-9cffe6b8ef84 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:57.353558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ff5fda46-2c51-4b26-b7a8-9cffe6b8ef84 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:57.361384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff5fda46-2c51-4b26-b7a8-9cffe6b8ef84 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.361863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff5fda46-2c51-4b26-b7a8-9cffe6b8ef84 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.362633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff5fda46-2c51-4b26-b7a8-9cffe6b8ef84 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.363106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff5fda46-2c51-4b26-b7a8-9cffe6b8ef84 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.364628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1c9e1c1-b644-4b24-aebe-f0e4dc432f33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:57.365554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1c9e1c1-b644-4b24-aebe-f0e4dc432f33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:57.372955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c9e1c1-b644-4b24-aebe-f0e4dc432f33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.373293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c9e1c1-b644-4b24-aebe-f0e4dc432f33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.374076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c9e1c1-b644-4b24-aebe-f0e4dc432f33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.374495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c9e1c1-b644-4b24-aebe-f0e4dc432f33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.394218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ff5fda46-2c51-4b26-b7a8-9cffe6b8ef84 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049045 Jun 17 12:59:57.394786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 549/1213] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:57.406227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1c9e1c1-b644-4b24-aebe-f0e4dc432f33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Jun 17 12:59:57.406862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 665/1214] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:57.779168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:57.779904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:57.783325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:57.787693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.788211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.789105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.789608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.794913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:57.807690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:57.808486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:57.815006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.815482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.816248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.816694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.880766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:57.890432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d6b81c93-6558-40b5-b4cc-9020ad18c6a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087102 Jun 17 12:59:57.891022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 666/1215] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:57 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:57.939084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:57.951120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f9903b50-17f2-46d5-8bfd-68ed42087f86 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.177785 Jun 17 12:59:57.951920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 550/1216] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:58.407627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c5f39c00-12c3-4bb6-b1d2-4c0bc40b6f9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:58.409840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c5f39c00-12c3-4bb6-b1d2-4c0bc40b6f9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:58.417431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5f39c00-12c3-4bb6-b1d2-4c0bc40b6f9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.417966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5f39c00-12c3-4bb6-b1d2-4c0bc40b6f9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.418141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6add685d-cc0d-4f34-a2aa-1f1d1f0cfe78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:58.418926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5f39c00-12c3-4bb6-b1d2-4c0bc40b6f9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.419072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6add685d-cc0d-4f34-a2aa-1f1d1f0cfe78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:58.419514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5f39c00-12c3-4bb6-b1d2-4c0bc40b6f9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.426116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6add685d-cc0d-4f34-a2aa-1f1d1f0cfe78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.426555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6add685d-cc0d-4f34-a2aa-1f1d1f0cfe78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.427319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6add685d-cc0d-4f34-a2aa-1f1d1f0cfe78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.427792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6add685d-cc0d-4f34-a2aa-1f1d1f0cfe78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.450608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c5f39c00-12c3-4bb6-b1d2-4c0bc40b6f9d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047107 Jun 17 12:59:58.451270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 667/1217] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:58.460772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6add685d-cc0d-4f34-a2aa-1f1d1f0cfe78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046659 Jun 17 12:59:58.461383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 551/1218] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:58.909873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:58.910458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:58.919154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.919633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.920408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.920844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.969451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:58.970054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:58.976658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.977101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.977865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.978286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.987896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:58.996832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3880e6b7-799f-4edc-8376-3c597a94b7be tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.090906 Jun 17 12:59:58.997400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 668/1219] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:58 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:59.129267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:59.141899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98f70432-5fe6-4440-96a2-6de30023fde8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175617 Jun 17 12:59:59.142862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 552/1220] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:59.463786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-667b774f-8933-4b16-9d76-90eb42093898 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:59.465220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-667b774f-8933-4b16-9d76-90eb42093898 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:59.473298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8551aafb-302e-407f-814d-d0b179dd2df1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:59.473894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-667b774f-8933-4b16-9d76-90eb42093898 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:59.474232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-667b774f-8933-4b16-9d76-90eb42093898 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:59.474388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8551aafb-302e-407f-814d-d0b179dd2df1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:59.475004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-667b774f-8933-4b16-9d76-90eb42093898 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:59.475451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-667b774f-8933-4b16-9d76-90eb42093898 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:59.481391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8551aafb-302e-407f-814d-d0b179dd2df1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:59.481839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8551aafb-302e-407f-814d-d0b179dd2df1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:59.482639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8551aafb-302e-407f-814d-d0b179dd2df1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:59.483080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8551aafb-302e-407f-814d-d0b179dd2df1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:59.512243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-667b774f-8933-4b16-9d76-90eb42093898 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053339 Jun 17 12:59:59.513317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 669/1221] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 12:59:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:59:59.515267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8551aafb-302e-407f-814d-d0b179dd2df1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Jun 17 12:59:59.515886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 553/1222] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 12:59:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:00.016592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:00.017213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:00.023535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.023985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.024722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.025155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.088629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:00.096877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4137ffd8-e451-4426-aeaf-914f6ab667f1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086251 Jun 17 13:00:00.097435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 670/1223] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:00 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:00.163808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:00.164892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:00.175225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.176050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.177292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.178013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.338193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:00.346343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-385713ac-ac3b-476a-b353-4fea7772b8b6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.189161 Jun 17 13:00:00.346905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 554/1224] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:00.525302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-580c1156-a1d2-49db-a34a-b8e6eacdfc24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:00.526197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9ebbd259-f48e-47cc-865f-5ea2edcdded3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:00.526633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-580c1156-a1d2-49db-a34a-b8e6eacdfc24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:00.527357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9ebbd259-f48e-47cc-865f-5ea2edcdded3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:00.533178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-580c1156-a1d2-49db-a34a-b8e6eacdfc24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.533623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-580c1156-a1d2-49db-a34a-b8e6eacdfc24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.534088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebbd259-f48e-47cc-865f-5ea2edcdded3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.534388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-580c1156-a1d2-49db-a34a-b8e6eacdfc24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.534541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebbd259-f48e-47cc-865f-5ea2edcdded3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.534814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-580c1156-a1d2-49db-a34a-b8e6eacdfc24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.535328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebbd259-f48e-47cc-865f-5ea2edcdded3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:00.535784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebbd259-f48e-47cc-865f-5ea2edcdded3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:00.566472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-580c1156-a1d2-49db-a34a-b8e6eacdfc24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045220 Jun 17 13:00:00.567294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9ebbd259-f48e-47cc-865f-5ea2edcdded3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Jun 17 13:00:00.567448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 671/1225] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:00.568658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 555/1226] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:01.117779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:01.118565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:01.129387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.130104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.131453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.132169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.199997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:01.208157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-97776d32-e5bb-4ada-968e-3c3e738fd22f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.097313 Jun 17 13:00:01.208723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 672/1227] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:01 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:01.364537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:01.365141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:01.372246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.372628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.373370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.373855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.510305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:01.518040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4967db6a-23ec-494f-b4fa-c964c1ce9daa tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.157464 Jun 17 13:00:01.518598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 556/1228] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:01.583256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e8b0448c-258c-4ed4-b80a-d85bb26e07bc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:01.584345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-09f4419c-6469-4db5-b4f7-5d3f31e60211 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:01.584981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e8b0448c-258c-4ed4-b80a-d85bb26e07bc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:01.585160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-09f4419c-6469-4db5-b4f7-5d3f31e60211 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:01.593608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8b0448c-258c-4ed4-b80a-d85bb26e07bc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.593809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09f4419c-6469-4db5-b4f7-5d3f31e60211 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.594118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09f4419c-6469-4db5-b4f7-5d3f31e60211 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.594433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8b0448c-258c-4ed4-b80a-d85bb26e07bc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.594886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09f4419c-6469-4db5-b4f7-5d3f31e60211 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.595208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8b0448c-258c-4ed4-b80a-d85bb26e07bc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.595351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09f4419c-6469-4db5-b4f7-5d3f31e60211 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.595673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8b0448c-258c-4ed4-b80a-d85bb26e07bc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.626485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-09f4419c-6469-4db5-b4f7-5d3f31e60211 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049926 Jun 17 13:00:01.626991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 673/1229] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:01.627221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e8b0448c-258c-4ed4-b80a-d85bb26e07bc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050291 Jun 17 13:00:01.627807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 557/1230] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:00:02.225377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:02.225991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:02.232616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.233062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.233806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.234262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.311527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:02.319795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-82567da9-343c-4dff-8038-6c1c522fc12c tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.098373 Jun 17 13:00:02.320350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 674/1231] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:02 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:02.538402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:02.539187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:02.547420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.547890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.548649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.549078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.639660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-09254c06-ab38-44b0-8662-e4cf8058aff4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:02.640649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-09254c06-ab38-44b0-8662-e4cf8058aff4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:02.648411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09254c06-ab38-44b0-8662-e4cf8058aff4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.648886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09254c06-ab38-44b0-8662-e4cf8058aff4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.649648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09254c06-ab38-44b0-8662-e4cf8058aff4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.650072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09254c06-ab38-44b0-8662-e4cf8058aff4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.682182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-09254c06-ab38-44b0-8662-e4cf8058aff4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047181 Jun 17 13:00:02.682733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 675/1232] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:02.687743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d67817f3-4454-465a-ab00-968d8d360a96 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:02.688661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d67817f3-4454-465a-ab00-968d8d360a96 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:02.694693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d67817f3-4454-465a-ab00-968d8d360a96 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.695139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d67817f3-4454-465a-ab00-968d8d360a96 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.695935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d67817f3-4454-465a-ab00-968d8d360a96 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.696371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d67817f3-4454-465a-ab00-968d8d360a96 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.706897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:02.714954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-37547845-cc92-4ac7-a042-7b4695c87f87 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.182652 Jun 17 13:00:02.722149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 558/1233] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:02.727124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d67817f3-4454-465a-ab00-968d8d360a96 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Jun 17 13:00:02.727722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 676/1234] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:03.340885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:03.342687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:03.353107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.353845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.355105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.355859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.422953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:03.434099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-09e287fd-e623-4f6c-9fec-f04e5109d58b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.099793 Jun 17 13:00:03.434762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 559/1235] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:03 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:03.698211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5f65321-6ad8-4f67-9626-693bd8c8e042 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:03.699565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5f65321-6ad8-4f67-9626-693bd8c8e042 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:03.710784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5f65321-6ad8-4f67-9626-693bd8c8e042 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.711596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5f65321-6ad8-4f67-9626-693bd8c8e042 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.712783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5f65321-6ad8-4f67-9626-693bd8c8e042 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.713476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5f65321-6ad8-4f67-9626-693bd8c8e042 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.718774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:03.732663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:03.733897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:03.741141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.741597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.742365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.742801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.751003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5f65321-6ad8-4f67-9626-693bd8c8e042 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059587 Jun 17 13:00:03.751584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 677/1236] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:03.756129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8efdaebc-03f7-4842-851e-29bd45d1f5e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:03.757047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8efdaebc-03f7-4842-851e-29bd45d1f5e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:03.762929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8efdaebc-03f7-4842-851e-29bd45d1f5e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.763360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8efdaebc-03f7-4842-851e-29bd45d1f5e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.764356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8efdaebc-03f7-4842-851e-29bd45d1f5e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.764935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8efdaebc-03f7-4842-851e-29bd45d1f5e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.804659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8efdaebc-03f7-4842-851e-29bd45d1f5e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051633 Jun 17 13:00:03.805665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 678/1237] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:03.879551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:03.887394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d5367c21-ba7c-49fa-b029-9976bf844cea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158611 Jun 17 13:00:03.887961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 560/1238] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:04.459581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:04.460670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:04.469723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.470172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.470961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.471410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.534534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:04.542311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-09d362cd-8942-4a5b-bbfd-6e456de2c9b2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089337 Jun 17 13:00:04.542869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 679/1239] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:04 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:04.766478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-62cd0fce-cc80-409e-9628-d26e7b1181c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:04.767618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-62cd0fce-cc80-409e-9628-d26e7b1181c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:04.775834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62cd0fce-cc80-409e-9628-d26e7b1181c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.776353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62cd0fce-cc80-409e-9628-d26e7b1181c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.777242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62cd0fce-cc80-409e-9628-d26e7b1181c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.777749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62cd0fce-cc80-409e-9628-d26e7b1181c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.810256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-62cd0fce-cc80-409e-9628-d26e7b1181c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050084 Jun 17 13:00:04.810834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 561/1240] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:04.820772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5405a266-9504-48c4-9d6d-ece02ad117fe tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:04.821962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5405a266-9504-48c4-9d6d-ece02ad117fe tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:04.830530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5405a266-9504-48c4-9d6d-ece02ad117fe tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.830986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5405a266-9504-48c4-9d6d-ece02ad117fe tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.831798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5405a266-9504-48c4-9d6d-ece02ad117fe tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.832234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5405a266-9504-48c4-9d6d-ece02ad117fe tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.861593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5405a266-9504-48c4-9d6d-ece02ad117fe tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047213 Jun 17 13:00:04.862170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 680/1241] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:04.905130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:04.905738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:04.912507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.912948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.913704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.914137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.054895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:05.063295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0e873b90-c90b-40a2-8b23-95dfb03a18ce tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162240 Jun 17 13:00:05.063910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 562/1242] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:05.560825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:05.561650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:05.570236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.570849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.571955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.572544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.639755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:05.647783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3f554e41-6dd1-41cb-8cb8-2392da86508e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092291 Jun 17 13:00:05.648355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 681/1243] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:05 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:05.826702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e85e9145-b522-4fc9-8208-1970f90b27a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:05.828828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e85e9145-b522-4fc9-8208-1970f90b27a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:05.839907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e85e9145-b522-4fc9-8208-1970f90b27a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.840637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e85e9145-b522-4fc9-8208-1970f90b27a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.841870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e85e9145-b522-4fc9-8208-1970f90b27a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.842579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e85e9145-b522-4fc9-8208-1970f90b27a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.875039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-664b1cb4-496b-4385-8b4a-0ef3e4b63fe7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:05.875999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-664b1cb4-496b-4385-8b4a-0ef3e4b63fe7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:05.882916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-664b1cb4-496b-4385-8b4a-0ef3e4b63fe7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.883395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-664b1cb4-496b-4385-8b4a-0ef3e4b63fe7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.884164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-664b1cb4-496b-4385-8b4a-0ef3e4b63fe7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.884620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-664b1cb4-496b-4385-8b4a-0ef3e4b63fe7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.888496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e85e9145-b522-4fc9-8208-1970f90b27a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068772 Jun 17 13:00:05.889061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 563/1244] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:05.915326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-664b1cb4-496b-4385-8b4a-0ef3e4b63fe7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Jun 17 13:00:05.915920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 682/1245] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:06.082560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:06.083418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:06.093633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.094031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.094799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.095242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.253954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:06.265718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-728c6e12-373e-4e80-b27c-e41869975792 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.188760 Jun 17 13:00:06.266272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 564/1246] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:06.668840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:06.669792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:06.677731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.678165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.679509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.680217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.748185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:06.756493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-735eab50-564c-42fb-9e97-81bfb3d36f54 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094125 Jun 17 13:00:06.757067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 683/1247] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:06 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:06.905086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-100c1b78-b975-4ff2-a58c-b5eeaa17ebe1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:06.906624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-100c1b78-b975-4ff2-a58c-b5eeaa17ebe1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:06.918024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-100c1b78-b975-4ff2-a58c-b5eeaa17ebe1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.918766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-100c1b78-b975-4ff2-a58c-b5eeaa17ebe1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.920200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-100c1b78-b975-4ff2-a58c-b5eeaa17ebe1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.920817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-100c1b78-b975-4ff2-a58c-b5eeaa17ebe1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.927100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a494f769-c231-4543-80d8-1bbf21949b08 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:06.928102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a494f769-c231-4543-80d8-1bbf21949b08 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:06.934642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a494f769-c231-4543-80d8-1bbf21949b08 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.935098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a494f769-c231-4543-80d8-1bbf21949b08 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.935883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a494f769-c231-4543-80d8-1bbf21949b08 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.936312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a494f769-c231-4543-80d8-1bbf21949b08 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.951314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-100c1b78-b975-4ff2-a58c-b5eeaa17ebe1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053044 Jun 17 13:00:06.951915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 565/1248] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:06.965534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a494f769-c231-4543-80d8-1bbf21949b08 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042339 Jun 17 13:00:06.966082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 684/1249] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:07.234986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:00:07.235301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:00:07.283286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:07.283922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:07.290815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.291258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.292078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.292491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.429654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:07.434197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:07.439285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9af664c3-ec87-46b7-8cce-0435cf646087 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160012 Jun 17 13:00:07.442135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 566/1250] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:07.776993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:07.777790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:07.788426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.789107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.790282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.790870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.857644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:07.865823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7ab41cd8-acb3-4eee-93ac-749a1b09c0d4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094963 Jun 17 13:00:07.866394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 685/1251] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:07 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:07.967546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-405f943d-e482-42f1-8fd9-2d9fb5e8eab5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:07.969069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-405f943d-e482-42f1-8fd9-2d9fb5e8eab5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:07.980880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-405f943d-e482-42f1-8fd9-2d9fb5e8eab5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.981147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-95134690-c13d-4f28-bd0a-fc3ab5b44538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:07.981860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-405f943d-e482-42f1-8fd9-2d9fb5e8eab5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.982731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-95134690-c13d-4f28-bd0a-fc3ab5b44538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:07.982960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-405f943d-e482-42f1-8fd9-2d9fb5e8eab5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.983581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-405f943d-e482-42f1-8fd9-2d9fb5e8eab5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.989727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95134690-c13d-4f28-bd0a-fc3ab5b44538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.990183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95134690-c13d-4f28-bd0a-fc3ab5b44538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.990933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95134690-c13d-4f28-bd0a-fc3ab5b44538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:07.991399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95134690-c13d-4f28-bd0a-fc3ab5b44538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:08.014022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-405f943d-e482-42f1-8fd9-2d9fb5e8eab5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053139 Jun 17 13:00:08.014613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 567/1252] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:08.024248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-95134690-c13d-4f28-bd0a-fc3ab5b44538 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049696 Jun 17 13:00:08.024850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 686/1253] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:08.456852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:08.457331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:08.464058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:08.464491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:08.465367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:08.465789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:08.609936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:08.618086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f361255e-944c-4861-b177-5eeb87437a59 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165834 Jun 17 13:00:08.618649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 568/1254] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:08.887437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:08.888451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:08.900176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:08.900871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:08.902150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:08.902855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:08.971342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:08.983782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5a3e7830-cfaf-4102-84fb-63dc431b8887 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.102441 Jun 17 13:00:08.984890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 687/1255] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:08 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:09.033402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-18df5301-2b83-43cd-9ee1-09931b8870c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:09.034938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-18df5301-2b83-43cd-9ee1-09931b8870c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:09.040190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f1240382-db96-4949-ade0-a4b7fd0550e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:09.041625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f1240382-db96-4949-ade0-a4b7fd0550e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:09.043515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18df5301-2b83-43cd-9ee1-09931b8870c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.044086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18df5301-2b83-43cd-9ee1-09931b8870c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.044856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18df5301-2b83-43cd-9ee1-09931b8870c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.045283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18df5301-2b83-43cd-9ee1-09931b8870c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.048870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1240382-db96-4949-ade0-a4b7fd0550e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.049555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1240382-db96-4949-ade0-a4b7fd0550e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.050695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1240382-db96-4949-ade0-a4b7fd0550e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.051122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1240382-db96-4949-ade0-a4b7fd0550e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.080701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-18df5301-2b83-43cd-9ee1-09931b8870c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057804 Jun 17 13:00:09.081467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 569/1256] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:09.095740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f1240382-db96-4949-ade0-a4b7fd0550e7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059834 Jun 17 13:00:09.096348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 688/1257] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:09.635954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:09.636564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:09.643079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.643554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.644313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.644743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.787073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:09.795089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-85516812-3f44-4025-a4ae-e2ceca19610b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163062 Jun 17 13:00:09.795692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 570/1258] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:09 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:10.011134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:10.012192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:10.020424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.020874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.021634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.022067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.092951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-61150195-0c50-4b1c-bf78-11f2fa274d24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:10.093376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:10.093901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-61150195-0c50-4b1c-bf78-11f2fa274d24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:10.100442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61150195-0c50-4b1c-bf78-11f2fa274d24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.100888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61150195-0c50-4b1c-bf78-11f2fa274d24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.101445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c4a62c1a-c1fe-4c48-86b5-23f702fa7ea4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.097227 Jun 17 13:00:10.101657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61150195-0c50-4b1c-bf78-11f2fa274d24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.105822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61150195-0c50-4b1c-bf78-11f2fa274d24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.105964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 689/1259] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:10 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:10.107528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3e9f568-d2a7-4dcb-ad48-c72b7356a7eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:10.108442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3e9f568-d2a7-4dcb-ad48-c72b7356a7eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:10.115087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3e9f568-d2a7-4dcb-ad48-c72b7356a7eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.115571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3e9f568-d2a7-4dcb-ad48-c72b7356a7eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.116869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3e9f568-d2a7-4dcb-ad48-c72b7356a7eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.116869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3e9f568-d2a7-4dcb-ad48-c72b7356a7eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.135209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-61150195-0c50-4b1c-bf78-11f2fa274d24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046132 Jun 17 13:00:10.135857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 571/1260] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:10.146927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3e9f568-d2a7-4dcb-ad48-c72b7356a7eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Jun 17 13:00:10.147495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 690/1261] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:10.812801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:10.813406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:10.820142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.820587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.821350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.821782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.957385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:10.965594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-01151b34-7007-4e9f-af83-bf02280ff217 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.156795 Jun 17 13:00:10.966131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 572/1262] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:10 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:11.122781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:11.123836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:11.131830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.132273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.133032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.133463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.148083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bac8f057-6a4f-4571-bf26-e3b204dd5e48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:11.149178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bac8f057-6a4f-4571-bf26-e3b204dd5e48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:11.155999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bac8f057-6a4f-4571-bf26-e3b204dd5e48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.156443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bac8f057-6a4f-4571-bf26-e3b204dd5e48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.157220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bac8f057-6a4f-4571-bf26-e3b204dd5e48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.157780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bac8f057-6a4f-4571-bf26-e3b204dd5e48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.189793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bac8f057-6a4f-4571-bf26-e3b204dd5e48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045934 Jun 17 13:00:11.190594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 573/1263] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:11.194963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98ce9c17-be93-4e2c-82fb-7b246f6b447c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:11.195912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98ce9c17-be93-4e2c-82fb-7b246f6b447c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:11.201910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ce9c17-be93-4e2c-82fb-7b246f6b447c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.202349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ce9c17-be93-4e2c-82fb-7b246f6b447c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.203102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ce9c17-be93-4e2c-82fb-7b246f6b447c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.203558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ce9c17-be93-4e2c-82fb-7b246f6b447c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.206879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:11.214491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-00a50acd-bbe6-4e5c-92a3-63138d075e82 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.098941 Jun 17 13:00:11.215124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 691/1264] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:11 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:11.232393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98ce9c17-be93-4e2c-82fb-7b246f6b447c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Jun 17 13:00:11.232980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 574/1265] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:11.986722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:11.987782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:11.998781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.999581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.000837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.001606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.137251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:12.145345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4bc45402-ce9a-4f81-bb0f-8d1a11a188f3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165231 Jun 17 13:00:12.145914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 692/1266] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:12.204614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e7bd8ea-7ecf-47e4-8beb-352fd2b8c69d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:12.205536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e7bd8ea-7ecf-47e4-8beb-352fd2b8c69d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:12.211765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e7bd8ea-7ecf-47e4-8beb-352fd2b8c69d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.212211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e7bd8ea-7ecf-47e4-8beb-352fd2b8c69d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.212969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e7bd8ea-7ecf-47e4-8beb-352fd2b8c69d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.213403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e7bd8ea-7ecf-47e4-8beb-352fd2b8c69d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.231717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:12.232329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:12.238755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.239318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.240125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.240525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.245423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e7bd8ea-7ecf-47e4-8beb-352fd2b8c69d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047086 Jun 17 13:00:12.246200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 575/1267] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:12.250863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5f24a327-1b7c-4281-98fe-245d9f0bf1da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:12.251949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5f24a327-1b7c-4281-98fe-245d9f0bf1da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:12.258266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f24a327-1b7c-4281-98fe-245d9f0bf1da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.258714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f24a327-1b7c-4281-98fe-245d9f0bf1da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.259522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f24a327-1b7c-4281-98fe-245d9f0bf1da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.259960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f24a327-1b7c-4281-98fe-245d9f0bf1da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.289377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5f24a327-1b7c-4281-98fe-245d9f0bf1da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042333 Jun 17 13:00:12.289925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 576/1268] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:12.304048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:12.307496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:12.311999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-55371a93-268e-4634-ad63-ed984f340641 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084317 Jun 17 13:00:12.312564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 693/1269] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:12 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:13.168432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:13.169039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:13.175784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.176230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.176991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.177433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.258750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f1a7a486-caf9-4291-9785-38cece825972 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:13.259707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f1a7a486-caf9-4291-9785-38cece825972 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:13.266635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1a7a486-caf9-4291-9785-38cece825972 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.267503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1a7a486-caf9-4291-9785-38cece825972 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.268562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1a7a486-caf9-4291-9785-38cece825972 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.269009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1a7a486-caf9-4291-9785-38cece825972 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.300443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f1a7a486-caf9-4291-9785-38cece825972 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046384 Jun 17 13:00:13.304541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 694/1270] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:13.305861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ca9c0d3c-8427-4b17-90b4-a79c64863fc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:13.306772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ca9c0d3c-8427-4b17-90b4-a79c64863fc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:13.313231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca9c0d3c-8427-4b17-90b4-a79c64863fc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.313821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca9c0d3c-8427-4b17-90b4-a79c64863fc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.314642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca9c0d3c-8427-4b17-90b4-a79c64863fc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.315077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca9c0d3c-8427-4b17-90b4-a79c64863fc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.331929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:13.339702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5e5c6f8a-2c73-4952-ba82-46bb4946651c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175149 Jun 17 13:00:13.340241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 577/1271] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:13.345489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ca9c0d3c-8427-4b17-90b4-a79c64863fc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043084 Jun 17 13:00:13.346191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 695/1272] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:13.349815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:13.350783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:13.360232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.360890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.362428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.363071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.448531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:13.456819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9bebbc02-3ffa-4a5f-8acb-3cd55c3ad875 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.115340 Jun 17 13:00:13.457396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 578/1273] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:13 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:14.312645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2e2e643f-3cc2-4c29-a21a-cca3f78072b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:14.313602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2e2e643f-3cc2-4c29-a21a-cca3f78072b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:14.320842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e2e643f-3cc2-4c29-a21a-cca3f78072b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.321288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e2e643f-3cc2-4c29-a21a-cca3f78072b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.322032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e2e643f-3cc2-4c29-a21a-cca3f78072b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.322503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e2e643f-3cc2-4c29-a21a-cca3f78072b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.355984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2e2e643f-3cc2-4c29-a21a-cca3f78072b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047235 Jun 17 13:00:14.356785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 696/1274] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:14.358280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-691e6523-4d60-4dbe-99fe-58b167bbe2d8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:14.359271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-691e6523-4d60-4dbe-99fe-58b167bbe2d8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:14.361540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:14.362148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:14.366942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-691e6523-4d60-4dbe-99fe-58b167bbe2d8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.367404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-691e6523-4d60-4dbe-99fe-58b167bbe2d8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.368333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-691e6523-4d60-4dbe-99fe-58b167bbe2d8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.368493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.368768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-691e6523-4d60-4dbe-99fe-58b167bbe2d8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.368928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.369683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.370110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.401669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-691e6523-4d60-4dbe-99fe-58b167bbe2d8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047601 Jun 17 13:00:14.402143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 579/1275] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:14.474190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:14.474918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:14.481782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.482233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.483009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.483642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.516519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:14.525529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a61c8fa1-5f01-4acc-8d11-36c85cbe2cf9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167904 Jun 17 13:00:14.526093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 697/1276] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:14.551928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:14.560042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9537c2ab-da52-4bb4-bd75-2e83c9f6d038 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089964 Jun 17 13:00:14.560630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 580/1277] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:14 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:14.966030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:00:14.966327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:00:15.369064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7dd03616-915d-4dcd-8793-3cdb46f2baf6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:15.369988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7dd03616-915d-4dcd-8793-3cdb46f2baf6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:15.377366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7dd03616-915d-4dcd-8793-3cdb46f2baf6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.377848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7dd03616-915d-4dcd-8793-3cdb46f2baf6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.378609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7dd03616-915d-4dcd-8793-3cdb46f2baf6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.379060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7dd03616-915d-4dcd-8793-3cdb46f2baf6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.409358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7dd03616-915d-4dcd-8793-3cdb46f2baf6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044302 Jun 17 13:00:15.409905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 698/1278] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:15.413948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b57177e-a827-4263-9c25-7c0c495bcec9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:15.414885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b57177e-a827-4263-9c25-7c0c495bcec9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:15.421884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b57177e-a827-4263-9c25-7c0c495bcec9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.422431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b57177e-a827-4263-9c25-7c0c495bcec9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.423316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b57177e-a827-4263-9c25-7c0c495bcec9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.424010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b57177e-a827-4263-9c25-7c0c495bcec9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.455480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b57177e-a827-4263-9c25-7c0c495bcec9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Jun 17 13:00:15.456072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 581/1279] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:15.544262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:15.545028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:15.552430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.552878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.553631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.554059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.577162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:15.577743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:15.584368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.585038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.586347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.586840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.656316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:15.664850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-52eeab60-60c0-4aab-8cde-8e39f4128d56 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091616 Jun 17 13:00:15.665464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 582/1280] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:15 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:15.693163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:15.700803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e951240-d68d-4e35-bd57-03de85bb6914 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.161001 Jun 17 13:00:15.701369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 699/1281] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:16.425916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0dc426db-da49-4acd-a6e5-318dbf40a7b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:16.426806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0dc426db-da49-4acd-a6e5-318dbf40a7b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:16.434075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc426db-da49-4acd-a6e5-318dbf40a7b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.434628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc426db-da49-4acd-a6e5-318dbf40a7b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.435469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc426db-da49-4acd-a6e5-318dbf40a7b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.435961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc426db-da49-4acd-a6e5-318dbf40a7b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.453405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:16.466390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e8465312-232a-4b2f-ba1f-eee71a734f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:16.467317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e8465312-232a-4b2f-ba1f-eee71a734f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:16.468660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0dc426db-da49-4acd-a6e5-318dbf40a7b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050862 Jun 17 13:00:16.469446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 583/1282] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:16.474599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8465312-232a-4b2f-ba1f-eee71a734f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.475045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8465312-232a-4b2f-ba1f-eee71a734f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.475866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8465312-232a-4b2f-ba1f-eee71a734f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.476299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8465312-232a-4b2f-ba1f-eee71a734f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.506360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e8465312-232a-4b2f-ba1f-eee71a734f07 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Jun 17 13:00:16.506910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 700/1283] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:16.681281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:16.681796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:16.688202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.688672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.689564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.689994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.718628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:16.719305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:16.727226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.727906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.728928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.729571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.759467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:16.767295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-269df65c-688c-402c-bf57-cc2fe80b92bc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.090089 Jun 17 13:00:16.767977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 584/1284] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:16 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:16.867361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:16.879598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e907085d-ad42-4d89-9a2b-7cdc8001fdb5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164942 Jun 17 13:00:16.880526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 701/1285] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:17.482150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-65cc8d53-764c-4cf2-ac10-143f2834c75f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:17.483192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-65cc8d53-764c-4cf2-ac10-143f2834c75f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:17.491445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cc8d53-764c-4cf2-ac10-143f2834c75f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.491963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cc8d53-764c-4cf2-ac10-143f2834c75f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.492789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cc8d53-764c-4cf2-ac10-143f2834c75f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.493298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cc8d53-764c-4cf2-ac10-143f2834c75f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.517609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f4b3daa3-b510-44af-a593-c2edee2b9727 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:17.518562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f4b3daa3-b510-44af-a593-c2edee2b9727 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:17.525703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4b3daa3-b510-44af-a593-c2edee2b9727 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.526173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4b3daa3-b510-44af-a593-c2edee2b9727 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.526992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4b3daa3-b510-44af-a593-c2edee2b9727 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.527417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-65cc8d53-764c-4cf2-ac10-143f2834c75f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050067 Jun 17 13:00:17.527559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4b3daa3-b510-44af-a593-c2edee2b9727 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.528075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 585/1286] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:17.559700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f4b3daa3-b510-44af-a593-c2edee2b9727 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Jun 17 13:00:17.560401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 702/1287] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:17.787702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:17.788319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:17.795415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.795875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.796674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.797108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.866568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:17.876016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aa7b95ed-8b9d-4e64-b2a6-baeacd73a218 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092633 Jun 17 13:00:17.876626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 586/1288] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:17 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:17.902545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:17.903157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:17.905063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:17.911038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.911497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.912258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.912684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:18.048482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:18.056451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dd3d409b-563c-4271-9ade-0c70378d7ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.157919 Jun 17 13:00:18.057018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 703/1289] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:18.541236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c8229baf-58ed-418e-b1eb-bac5743e3e10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:18.542141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c8229baf-58ed-418e-b1eb-bac5743e3e10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:18.548690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8229baf-58ed-418e-b1eb-bac5743e3e10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:18.549140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8229baf-58ed-418e-b1eb-bac5743e3e10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:18.549882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8229baf-58ed-418e-b1eb-bac5743e3e10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:18.550338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8229baf-58ed-418e-b1eb-bac5743e3e10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:18.572928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-375bf96d-b5da-4622-aad5-ac9674dd5928 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:18.573877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-375bf96d-b5da-4622-aad5-ac9674dd5928 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:18.583169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c8229baf-58ed-418e-b1eb-bac5743e3e10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046903 Jun 17 13:00:18.583779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 587/1290] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:18.584515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-375bf96d-b5da-4622-aad5-ac9674dd5928 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:18.585201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-375bf96d-b5da-4622-aad5-ac9674dd5928 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:18.585986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-375bf96d-b5da-4622-aad5-ac9674dd5928 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:18.586425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-375bf96d-b5da-4622-aad5-ac9674dd5928 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:18.640383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-375bf96d-b5da-4622-aad5-ac9674dd5928 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071053 Jun 17 13:00:18.641450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 704/1291] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:18.897506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:18.898057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:18.904876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:18.905324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:18.906086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:18.906517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:18.978965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:18.987043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-278fac83-335c-487a-a17f-afaecb82a87e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094831 Jun 17 13:00:18.987679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 588/1292] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:18 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:19.073790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:19.074402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.080911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.081364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.082177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.082609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.231265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:19.240106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f958d0d-af1d-4518-89a4-856dae2dce9f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170200 Jun 17 13:00:19.240683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 705/1293] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:19.596710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-44e70460-9634-46c7-9e06-d736a0fab834 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:19.597963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-44e70460-9634-46c7-9e06-d736a0fab834 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.605484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e70460-9634-46c7-9e06-d736a0fab834 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.605923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e70460-9634-46c7-9e06-d736a0fab834 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.606674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e70460-9634-46c7-9e06-d736a0fab834 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.607091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e70460-9634-46c7-9e06-d736a0fab834 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.641291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-44e70460-9634-46c7-9e06-d736a0fab834 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048279 Jun 17 13:00:19.642232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 589/1294] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:19.655556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6679c544-488f-4281-97bf-2f3490c1110a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:19.656557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6679c544-488f-4281-97bf-2f3490c1110a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.665202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6679c544-488f-4281-97bf-2f3490c1110a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.665876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6679c544-488f-4281-97bf-2f3490c1110a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.666815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6679c544-488f-4281-97bf-2f3490c1110a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.667216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6679c544-488f-4281-97bf-2f3490c1110a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.705651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6679c544-488f-4281-97bf-2f3490c1110a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054705 Jun 17 13:00:19.706250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 706/1295] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:20.006909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:20.007580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:20.014161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.014615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.015383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.015845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.106667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:20.115664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-55912977-b40d-40fe-aa6f-f8fe52366d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.113669 Jun 17 13:00:20.116542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 590/1296] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:20 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:20.261384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:20.262216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:20.272333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.272999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.274161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.274807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.437178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:20.445887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1b150ad1-8435-4716-b8d4-3b9e7d503316 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.191135 Jun 17 13:00:20.446480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 707/1297] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:20 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:20.655528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cc255179-5453-407e-bb78-f10f8de34e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:20.656357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cc255179-5453-407e-bb78-f10f8de34e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:20.663344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc255179-5453-407e-bb78-f10f8de34e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.663836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc255179-5453-407e-bb78-f10f8de34e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.664598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc255179-5453-407e-bb78-f10f8de34e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.665031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc255179-5453-407e-bb78-f10f8de34e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.694261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cc255179-5453-407e-bb78-f10f8de34e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043120 Jun 17 13:00:20.694842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 591/1298] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:20.721179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e2471b2e-fc66-4863-8b39-092b86c0ba1b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:20.722192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e2471b2e-fc66-4863-8b39-092b86c0ba1b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:20.729332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2471b2e-fc66-4863-8b39-092b86c0ba1b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.729780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2471b2e-fc66-4863-8b39-092b86c0ba1b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.730550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2471b2e-fc66-4863-8b39-092b86c0ba1b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.730982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2471b2e-fc66-4863-8b39-092b86c0ba1b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.764614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e2471b2e-fc66-4863-8b39-092b86c0ba1b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Jun 17 13:00:20.765142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 708/1299] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:21.134861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:21.135498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:21.143676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.144128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.145305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.146040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.227179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:21.234926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-57930eec-a303-49da-9c8c-c08bd40cbd73 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.105096 Jun 17 13:00:21.235514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 592/1300] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:21 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:21.464807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:21.465325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:21.474280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.474730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.475526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.475955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.626663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:21.635260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-973472c7-1346-463b-9116-c31193fc8f92 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.174565 Jun 17 13:00:21.635855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 709/1301] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:21 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:21.705445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ced7344d-fe8f-4a7e-a416-226afc2726ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:21.706360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ced7344d-fe8f-4a7e-a416-226afc2726ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:21.713138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ced7344d-fe8f-4a7e-a416-226afc2726ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.713578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ced7344d-fe8f-4a7e-a416-226afc2726ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.714329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ced7344d-fe8f-4a7e-a416-226afc2726ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.714765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ced7344d-fe8f-4a7e-a416-226afc2726ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.746777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ced7344d-fe8f-4a7e-a416-226afc2726ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045185 Jun 17 13:00:21.747139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 593/1302] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:21.778929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4c884e57-d684-4b05-97d8-3faff7f9c3d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:21.780192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4c884e57-d684-4b05-97d8-3faff7f9c3d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:21.787347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c884e57-d684-4b05-97d8-3faff7f9c3d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.787834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c884e57-d684-4b05-97d8-3faff7f9c3d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.788578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c884e57-d684-4b05-97d8-3faff7f9c3d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.789042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c884e57-d684-4b05-97d8-3faff7f9c3d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.813157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:21.829041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4c884e57-d684-4b05-97d8-3faff7f9c3d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055959 Jun 17 13:00:21.829720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 710/1303] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:22.257486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:22.258081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:22.264333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.264775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.265526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.265951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.330738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:22.339865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-51e54253-ef19-4799-9746-d58710a26102 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086977 Jun 17 13:00:22.340419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 594/1304] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:22 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:22.653978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:22.654541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:22.667249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.667724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.668511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.668946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.763396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c58ef6f8-7a88-48a2-b760-20aef7adc65e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:22.764983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c58ef6f8-7a88-48a2-b760-20aef7adc65e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:22.782094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c58ef6f8-7a88-48a2-b760-20aef7adc65e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.782516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c58ef6f8-7a88-48a2-b760-20aef7adc65e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.783281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c58ef6f8-7a88-48a2-b760-20aef7adc65e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.783736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c58ef6f8-7a88-48a2-b760-20aef7adc65e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.836519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c58ef6f8-7a88-48a2-b760-20aef7adc65e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080779 Jun 17 13:00:22.837119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 595/1305] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:22.841756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de22c88d-346d-4785-a544-0c8a225f80fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:22.842656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-de22c88d-346d-4785-a544-0c8a225f80fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:22.849287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de22c88d-346d-4785-a544-0c8a225f80fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.849724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de22c88d-346d-4785-a544-0c8a225f80fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.850609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de22c88d-346d-4785-a544-0c8a225f80fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.851044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de22c88d-346d-4785-a544-0c8a225f80fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.853791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:22.861490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-63554b7f-ff67-422d-b50b-8b51ad80f3bd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.211728 Jun 17 13:00:22.862066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 711/1306] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:22.883795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-de22c88d-346d-4785-a544-0c8a225f80fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Jun 17 13:00:22.884475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 596/1307] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:23.361960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:23.362944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:23.370288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.370654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.371470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.371908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.449415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:23.460477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-49723ff5-b592-46cb-8cd4-8910c0cbf110 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.104802 Jun 17 13:00:23.461258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 712/1308] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:23 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:23.852573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fac9198e-4472-494a-a274-a630557a1148 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:23.854100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fac9198e-4472-494a-a274-a630557a1148 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:23.864326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac9198e-4472-494a-a274-a630557a1148 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.864784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac9198e-4472-494a-a274-a630557a1148 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.865544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac9198e-4472-494a-a274-a630557a1148 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.865980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac9198e-4472-494a-a274-a630557a1148 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.879839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:23.880406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:23.887006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.887486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.888247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.888671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.896511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fac9198e-4472-494a-a274-a630557a1148 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050538 Jun 17 13:00:23.897088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 597/1309] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:23.901631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-608b8196-945a-4ff5-b35a-6b9817f5289c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:23.902541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-608b8196-945a-4ff5-b35a-6b9817f5289c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:23.908736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-608b8196-945a-4ff5-b35a-6b9817f5289c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.909187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-608b8196-945a-4ff5-b35a-6b9817f5289c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.909947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-608b8196-945a-4ff5-b35a-6b9817f5289c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.910385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-608b8196-945a-4ff5-b35a-6b9817f5289c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.940994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-608b8196-945a-4ff5-b35a-6b9817f5289c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Jun 17 13:00:23.941467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 598/1310] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:24.026879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:24.034727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-793a064e-9ed8-4a95-b299-6220a2f5d353 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.158788 Jun 17 13:00:24.035292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 713/1311] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:24.479247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:24.479904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:24.486375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.486823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.487617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.488040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.550731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:24.558516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4a951449-3a02-40ac-b66f-2b4a33a60d30 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083234 Jun 17 13:00:24.559063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 599/1312] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:24 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:24.909142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1b16972e-6bc4-4cbb-99ea-95684250e6dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:24.910552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1b16972e-6bc4-4cbb-99ea-95684250e6dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:24.918275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b16972e-6bc4-4cbb-99ea-95684250e6dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.918710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b16972e-6bc4-4cbb-99ea-95684250e6dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.919492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b16972e-6bc4-4cbb-99ea-95684250e6dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.920231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b16972e-6bc4-4cbb-99ea-95684250e6dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.953138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4cd38adf-d30d-47f7-b737-da72c44c7ab5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:24.954076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4cd38adf-d30d-47f7-b737-da72c44c7ab5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:24.957229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1b16972e-6bc4-4cbb-99ea-95684250e6dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052291 Jun 17 13:00:24.957397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:24.958075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 714/1313] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:24.961059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cd38adf-d30d-47f7-b737-da72c44c7ab5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.961504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cd38adf-d30d-47f7-b737-da72c44c7ab5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.962542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cd38adf-d30d-47f7-b737-da72c44c7ab5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.963157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cd38adf-d30d-47f7-b737-da72c44c7ab5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.969807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:24.998790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4cd38adf-d30d-47f7-b737-da72c44c7ab5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049275 Jun 17 13:00:24.999352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 600/1314] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:25.055856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:25.056615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:25.066646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.067475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:25.068635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.069122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:25.228942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:25.236947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-83682cea-0928-402c-9a4c-77a02527249a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.187954 Jun 17 13:00:25.237543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 715/1315] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:25.578278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:25.579135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:25.587152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.587636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:25.588402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.588834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:25.659760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:25.668067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f698111d-bce7-4e03-b80c-4763e9c522e8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095356 Jun 17 13:00:25.668634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 601/1316] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:25 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:25.972984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d7d3be8c-28a0-403d-bc5d-9e640331223b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:25.974398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d7d3be8c-28a0-403d-bc5d-9e640331223b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:25.984140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7d3be8c-28a0-403d-bc5d-9e640331223b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.984579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7d3be8c-28a0-403d-bc5d-9e640331223b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:25.985325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7d3be8c-28a0-403d-bc5d-9e640331223b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.985749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7d3be8c-28a0-403d-bc5d-9e640331223b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.014917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-970f6fbc-63a1-402e-b8c1-76f50648e872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:26.015931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-970f6fbc-63a1-402e-b8c1-76f50648e872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:26.022130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d7d3be8c-28a0-403d-bc5d-9e640331223b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055551 Jun 17 13:00:26.022789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 716/1317] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:26.024454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-970f6fbc-63a1-402e-b8c1-76f50648e872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.024904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-970f6fbc-63a1-402e-b8c1-76f50648e872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.025796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-970f6fbc-63a1-402e-b8c1-76f50648e872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.026229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-970f6fbc-63a1-402e-b8c1-76f50648e872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.058668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-970f6fbc-63a1-402e-b8c1-76f50648e872 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049124 Jun 17 13:00:26.059247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 602/1318] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:00:26.255639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:26.256249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:26.264467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.265043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.266191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.266819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.416343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:26.424283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e275e9a-82b6-4c0c-9fbd-72a1b80be07d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173068 Jun 17 13:00:26.424854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 717/1319] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:26.691305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:26.692136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:26.705766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.706658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.708201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.709041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.796788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:26.808899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be274224-33d6-43fa-bf3e-ab99cf325f3e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.122209 Jun 17 13:00:26.810224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 603/1320] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:26 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:27.036319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-05696ad1-bddf-4d53-9e56-11aafb39f6f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:27.038151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-05696ad1-bddf-4d53-9e56-11aafb39f6f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:27.047895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05696ad1-bddf-4d53-9e56-11aafb39f6f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.048446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05696ad1-bddf-4d53-9e56-11aafb39f6f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.049468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05696ad1-bddf-4d53-9e56-11aafb39f6f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.050065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05696ad1-bddf-4d53-9e56-11aafb39f6f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.072256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8891e50a-abf3-4c6c-9d29-89daa8936cc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:27.073207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8891e50a-abf3-4c6c-9d29-89daa8936cc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:27.080392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8891e50a-abf3-4c6c-9d29-89daa8936cc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.080860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8891e50a-abf3-4c6c-9d29-89daa8936cc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.081618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8891e50a-abf3-4c6c-9d29-89daa8936cc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.082040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8891e50a-abf3-4c6c-9d29-89daa8936cc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.115467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-05696ad1-bddf-4d53-9e56-11aafb39f6f1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084403 Jun 17 13:00:27.117943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 718/1321] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:27.125131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8891e50a-abf3-4c6c-9d29-89daa8936cc6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058143 Jun 17 13:00:27.125771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 604/1322] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:27.443180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:27.444443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:27.452067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.452483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.453260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.453765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.598930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:27.607281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2c9c8dc0-e617-4ca1-a2e2-121749e15afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169034 Jun 17 13:00:27.607563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 719/1323] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:27.835804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:27.836580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:27.843596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.844030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.844799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.845225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.908555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:27.917039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-014eb477-3bba-4171-a83a-2d85064abde4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088508 Jun 17 13:00:27.917665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 605/1324] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:27 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:28.130303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3bc8cc9c-6078-4608-93f7-6f7f798e91ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:28.131255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3bc8cc9c-6078-4608-93f7-6f7f798e91ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:28.138063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f5d49bf-3670-427d-9d39-cb99b3741915 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:28.138946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc8cc9c-6078-4608-93f7-6f7f798e91ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.139108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f5d49bf-3670-427d-9d39-cb99b3741915 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:28.139413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc8cc9c-6078-4608-93f7-6f7f798e91ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.140167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc8cc9c-6078-4608-93f7-6f7f798e91ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.140591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3bc8cc9c-6078-4608-93f7-6f7f798e91ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.146700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f5d49bf-3670-427d-9d39-cb99b3741915 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.147188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f5d49bf-3670-427d-9d39-cb99b3741915 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.148359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f5d49bf-3670-427d-9d39-cb99b3741915 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.148817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f5d49bf-3670-427d-9d39-cb99b3741915 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.182126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f5d49bf-3670-427d-9d39-cb99b3741915 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047956 Jun 17 13:00:28.182680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 606/1325] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:28.186937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3bc8cc9c-6078-4608-93f7-6f7f798e91ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060635 Jun 17 13:00:28.187521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 720/1326] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:28.627769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:28.628644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:28.637799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.638310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.639084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.639564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.835156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:28.844061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ecb662ff-c7c6-4103-95e8-484e22d14744 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.222823 Jun 17 13:00:28.844719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 607/1327] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:28.944629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:28.945226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:28.951844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.952290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.953054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.953508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:29.021445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:29.029907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-348a9958-1541-4d3e-9ec6-386bc875758b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091554 Jun 17 13:00:29.030483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 721/1328] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:28 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:29.195086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-58910811-6e32-4a2f-8bfc-f4918f9c6374 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:29.195933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-58910811-6e32-4a2f-8bfc-f4918f9c6374 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:29.198714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e602008b-980d-4621-9870-942bcfc97ebc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:29.199682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e602008b-980d-4621-9870-942bcfc97ebc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:29.203409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58910811-6e32-4a2f-8bfc-f4918f9c6374 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:29.204115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58910811-6e32-4a2f-8bfc-f4918f9c6374 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:29.205031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58910811-6e32-4a2f-8bfc-f4918f9c6374 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:29.205463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-58910811-6e32-4a2f-8bfc-f4918f9c6374 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:29.208353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e602008b-980d-4621-9870-942bcfc97ebc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:29.209060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e602008b-980d-4621-9870-942bcfc97ebc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:29.210315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e602008b-980d-4621-9870-942bcfc97ebc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:29.210947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e602008b-980d-4621-9870-942bcfc97ebc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:29.238819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-58910811-6e32-4a2f-8bfc-f4918f9c6374 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048079 Jun 17 13:00:29.239445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 608/1329] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:29.257099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e602008b-980d-4621-9870-942bcfc97ebc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062337 Jun 17 13:00:29.257780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 722/1330] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:29.861999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:29.862631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:29.869997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:29.870414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:29.871208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:29.871646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.020064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:30.027938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bfa24bac-86e6-4a66-8ad6-1f4709397d84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170041 Jun 17 13:00:30.028495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 609/1331] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:30.046064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:30.046674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:30.052874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.053420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.054124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.054557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.120245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:30.130564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-61826792-0a4b-4c6d-9ba6-9e0094b8f561 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088259 Jun 17 13:00:30.131170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 723/1332] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:30 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:30.257306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ac00df3f-e1c8-40d7-aef0-189817025c7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:30.258212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ac00df3f-e1c8-40d7-aef0-189817025c7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:30.266440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac00df3f-e1c8-40d7-aef0-189817025c7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.267129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac00df3f-e1c8-40d7-aef0-189817025c7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.268435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac00df3f-e1c8-40d7-aef0-189817025c7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.269038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac00df3f-e1c8-40d7-aef0-189817025c7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.271751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f0762aa6-73c7-4a9d-bc57-67cc46d015be tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:30.273735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f0762aa6-73c7-4a9d-bc57-67cc46d015be tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:30.284440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0762aa6-73c7-4a9d-bc57-67cc46d015be tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.284895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0762aa6-73c7-4a9d-bc57-67cc46d015be tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.286083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0762aa6-73c7-4a9d-bc57-67cc46d015be tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.286745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f0762aa6-73c7-4a9d-bc57-67cc46d015be tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.306913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ac00df3f-e1c8-40d7-aef0-189817025c7f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056004 Jun 17 13:00:30.307533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 610/1333] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:30.319505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f0762aa6-73c7-4a9d-bc57-67cc46d015be tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053543 Jun 17 13:00:30.320096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 724/1334] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:31.046100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:31.046695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:31.053481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.054510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.055281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.055745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.147855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:31.148647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:31.155060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.155551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.156328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.156759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.197215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:31.205501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a4fab25b-21ec-4335-9821-cad9bcf7254e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163157 Jun 17 13:00:31.205954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 611/1335] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:31.220887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:31.228993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4be0ff43-f28f-4675-b631-540ea0b5a793 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085021 Jun 17 13:00:31.229564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 725/1336] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:31 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:31.319215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-33b82c34-8707-42a7-9530-248e020f7db4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:31.320195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-33b82c34-8707-42a7-9530-248e020f7db4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:31.328627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33b82c34-8707-42a7-9530-248e020f7db4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.329200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33b82c34-8707-42a7-9530-248e020f7db4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.331261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33b82c34-8707-42a7-9530-248e020f7db4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.331261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33b82c34-8707-42a7-9530-248e020f7db4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.334014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0d703ce6-d483-499b-a5cf-fc9881c7ab25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:31.335202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d703ce6-d483-499b-a5cf-fc9881c7ab25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:31.342210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d703ce6-d483-499b-a5cf-fc9881c7ab25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.342660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d703ce6-d483-499b-a5cf-fc9881c7ab25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.343456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d703ce6-d483-499b-a5cf-fc9881c7ab25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.343889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d703ce6-d483-499b-a5cf-fc9881c7ab25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.367039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-33b82c34-8707-42a7-9530-248e020f7db4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051892 Jun 17 13:00:31.368026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 612/1337] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:31.379581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0d703ce6-d483-499b-a5cf-fc9881c7ab25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052744 Jun 17 13:00:31.380193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 726/1338] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:32.222390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:32.222994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:32.229825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.230268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.231029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.231485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.245794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:32.246423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:32.253209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.253665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.254439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.254872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.259217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:32.319567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:32.328442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc4963a3-d260-40fb-9abc-0ebc0da91fe1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086502 Jun 17 13:00:32.329003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 727/1339] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:32 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:32.377455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:32.378702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3430ea6-4f8c-42d8-ad27-610b4bf332e8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:32.379667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3430ea6-4f8c-42d8-ad27-610b4bf332e8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:32.385716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-24cb726e-7a1e-4974-8ac9-57d3f461e4ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167255 Jun 17 13:00:32.386307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 613/1340] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:32.389091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3430ea6-4f8c-42d8-ad27-610b4bf332e8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.389804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3430ea6-4f8c-42d8-ad27-610b4bf332e8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.391333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3430ea6-4f8c-42d8-ad27-610b4bf332e8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.392027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3430ea6-4f8c-42d8-ad27-610b4bf332e8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.395130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4851ce25-1492-4ec1-92d4-763e9d541cbc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:32.396642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4851ce25-1492-4ec1-92d4-763e9d541cbc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:32.406589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4851ce25-1492-4ec1-92d4-763e9d541cbc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.407294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4851ce25-1492-4ec1-92d4-763e9d541cbc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.408548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4851ce25-1492-4ec1-92d4-763e9d541cbc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.409239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4851ce25-1492-4ec1-92d4-763e9d541cbc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.440977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3430ea6-4f8c-42d8-ad27-610b4bf332e8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065635 Jun 17 13:00:32.447330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 728/1341] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:32.456942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4851ce25-1492-4ec1-92d4-763e9d541cbc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068311 Jun 17 13:00:32.457958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 614/1342] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:33.349969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:33.350991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:33.357873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.358317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.359107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.359579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.402831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:33.403434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:33.410177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.410617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.411351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.411792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.430345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:33.435150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-870d9117-78af-470e-a50f-b9f1730ea417 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091947 Jun 17 13:00:33.439030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 729/1343] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:33 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:33.454206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4bcafa4f-8efa-432a-ac92-261225a7074d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:33.455177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4bcafa4f-8efa-432a-ac92-261225a7074d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:33.461410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bcafa4f-8efa-432a-ac92-261225a7074d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.461847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bcafa4f-8efa-432a-ac92-261225a7074d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.462613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bcafa4f-8efa-432a-ac92-261225a7074d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.463041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bcafa4f-8efa-432a-ac92-261225a7074d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.492839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4bcafa4f-8efa-432a-ac92-261225a7074d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 Jun 17 13:00:33.493592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 730/1344] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:00:33.497967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-637204e3-5c67-41ae-9279-c47c5c5bb334 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:33.499227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-637204e3-5c67-41ae-9279-c47c5c5bb334 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:33.505304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637204e3-5c67-41ae-9279-c47c5c5bb334 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.505748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637204e3-5c67-41ae-9279-c47c5c5bb334 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.506503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637204e3-5c67-41ae-9279-c47c5c5bb334 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:33.507050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-637204e3-5c67-41ae-9279-c47c5c5bb334 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.537375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-637204e3-5c67-41ae-9279-c47c5c5bb334 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042895 Jun 17 13:00:33.537928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 731/1345] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:33.551604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:33.559630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1dac59eb-0bcb-4c26-8063-0db691ce0a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160729 Jun 17 13:00:33.560179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 615/1346] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:34.455838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:34.456422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:34.464429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.464882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.465645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.466082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.504963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-42a0b852-6a14-4d32-9def-d3d0d5c9d828 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:34.505891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-42a0b852-6a14-4d32-9def-d3d0d5c9d828 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:34.512742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42a0b852-6a14-4d32-9def-d3d0d5c9d828 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.513181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42a0b852-6a14-4d32-9def-d3d0d5c9d828 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.513947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42a0b852-6a14-4d32-9def-d3d0d5c9d828 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.514375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42a0b852-6a14-4d32-9def-d3d0d5c9d828 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.529641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:34.537634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5b40a452-e633-4c8f-8396-181b6d4125ea tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088271 Jun 17 13:00:34.546874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 732/1347] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:34 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:34.547072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:34.547072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-42a0b852-6a14-4d32-9def-d3d0d5c9d828 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Jun 17 13:00:34.547072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 616/1348] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:00:34.549594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b866a724-81f3-4647-82c2-0a92b3080ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:34.550519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b866a724-81f3-4647-82c2-0a92b3080ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:34.556802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b866a724-81f3-4647-82c2-0a92b3080ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.557264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b866a724-81f3-4647-82c2-0a92b3080ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.558020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b866a724-81f3-4647-82c2-0a92b3080ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.558457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b866a724-81f3-4647-82c2-0a92b3080ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.576279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:34.576878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:34.583411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.583874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.584619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.585023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.587672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b866a724-81f3-4647-82c2-0a92b3080ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042007 Jun 17 13:00:34.588237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 733/1349] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:34.727758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:34.735588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4b5a78e2-fc9c-4522-b3b2-5f6ce1285e6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163105 Jun 17 13:00:34.736156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 617/1350] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:35.558641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3fedb250-6b78-4353-bb25-8171eb5ea68b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:35.559643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:35.560233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3fedb250-6b78-4353-bb25-8171eb5ea68b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:35.560438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:35.569491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fedb250-6b78-4353-bb25-8171eb5ea68b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.570115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.570689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fedb250-6b78-4353-bb25-8171eb5ea68b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.570816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.570973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fedb250-6b78-4353-bb25-8171eb5ea68b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.571401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.571589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fedb250-6b78-4353-bb25-8171eb5ea68b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.571876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.603068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3fedb250-6b78-4353-bb25-8171eb5ea68b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050193 Jun 17 13:00:35.603684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 618/1351] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:35.608912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fd0cd184-12e0-4b0f-94d1-f897ef75f63f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:35.609860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fd0cd184-12e0-4b0f-94d1-f897ef75f63f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:35.616078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd0cd184-12e0-4b0f-94d1-f897ef75f63f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.616557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd0cd184-12e0-4b0f-94d1-f897ef75f63f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.617326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd0cd184-12e0-4b0f-94d1-f897ef75f63f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.617782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd0cd184-12e0-4b0f-94d1-f897ef75f63f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.641266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:35.649418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fd0cd184-12e0-4b0f-94d1-f897ef75f63f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Jun 17 13:00:35.650286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 619/1352] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:35.650607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34480d8a-e8bb-4e7c-a28b-6205a8d43f99 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.099348 Jun 17 13:00:35.651346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 734/1353] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:35 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:35.753362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:35.753950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:35.760959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.761397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.762149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.762572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.895530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:35.904101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f63b290b-66d5-42bd-937d-128b2e615ae6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.155050 Jun 17 13:00:35.904637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 620/1354] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:36.616043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ea20c905-ac73-4987-b402-3d69f8ec277d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:36.617270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ea20c905-ac73-4987-b402-3d69f8ec277d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:36.624817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea20c905-ac73-4987-b402-3d69f8ec277d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.625312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea20c905-ac73-4987-b402-3d69f8ec277d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.626557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea20c905-ac73-4987-b402-3d69f8ec277d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.626738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea20c905-ac73-4987-b402-3d69f8ec277d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.660033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ea20c905-ac73-4987-b402-3d69f8ec277d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048672 Jun 17 13:00:36.661069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 735/1355] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:36.661903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d80571e6-70e6-4509-b420-e382a7590e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:36.662777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d80571e6-70e6-4509-b420-e382a7590e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:36.665980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:36.666580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:36.671139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d80571e6-70e6-4509-b420-e382a7590e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.671848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d80571e6-70e6-4509-b420-e382a7590e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.672458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d80571e6-70e6-4509-b420-e382a7590e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.672862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.672988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d80571e6-70e6-4509-b420-e382a7590e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.673300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.674247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.674621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.710469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d80571e6-70e6-4509-b420-e382a7590e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052431 Jun 17 13:00:36.711180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 621/1356] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:36.747199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:36.755547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5c9eadb-4380-4804-85a4-ec0078a57936 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.093502 Jun 17 13:00:36.756124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 736/1357] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:36 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:36.925766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:36.926445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:36.937314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.938024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.939251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.939904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.076500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:37.084754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-482f8e51-a101-48c3-b4dc-34481c97e4e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165747 Jun 17 13:00:37.085362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 622/1358] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:37.672357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-04c44331-8b47-4722-9ee1-345bfb15eed3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:37.673358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-04c44331-8b47-4722-9ee1-345bfb15eed3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:37.681035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04c44331-8b47-4722-9ee1-345bfb15eed3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.681651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04c44331-8b47-4722-9ee1-345bfb15eed3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.682763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04c44331-8b47-4722-9ee1-345bfb15eed3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.683190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04c44331-8b47-4722-9ee1-345bfb15eed3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.717789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-04c44331-8b47-4722-9ee1-345bfb15eed3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049437 Jun 17 13:00:37.718481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 737/1359] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:37.723520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a9b6211-3ebe-4223-b7b6-cd4059cf253d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:37.724653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a9b6211-3ebe-4223-b7b6-cd4059cf253d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:37.731754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a9b6211-3ebe-4223-b7b6-cd4059cf253d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.732296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a9b6211-3ebe-4223-b7b6-cd4059cf253d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.732945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a9b6211-3ebe-4223-b7b6-cd4059cf253d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.733374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a9b6211-3ebe-4223-b7b6-cd4059cf253d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.765271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a9b6211-3ebe-4223-b7b6-cd4059cf253d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046191 Jun 17 13:00:37.765860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 623/1360] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:37.773904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:37.774844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:37.784118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.784766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.785914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.786612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.852146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:37.860051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5be78b3e-5abf-4928-8cd4-9c1211c10773 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091335 Jun 17 13:00:37.860609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 738/1361] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:37 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:38.102412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:38.103023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:38.109597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.110064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.110822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.111229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.243261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:38.251299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c232985-07a7-43b6-8faa-7a41f26805e6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.152979 Jun 17 13:00:38.251893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 624/1362] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:38.731009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dfe5b6b8-daf0-4fde-9d5a-2cc173c78660 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:38.731998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dfe5b6b8-daf0-4fde-9d5a-2cc173c78660 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:38.738777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfe5b6b8-daf0-4fde-9d5a-2cc173c78660 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.739229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfe5b6b8-daf0-4fde-9d5a-2cc173c78660 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.740011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfe5b6b8-daf0-4fde-9d5a-2cc173c78660 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.740439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfe5b6b8-daf0-4fde-9d5a-2cc173c78660 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.771218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dfe5b6b8-daf0-4fde-9d5a-2cc173c78660 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Jun 17 13:00:38.771823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 739/1363] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:38.777808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5fc0b05b-ff88-45ca-b80a-523af76d6067 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:38.778752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5fc0b05b-ff88-45ca-b80a-523af76d6067 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:38.785743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fc0b05b-ff88-45ca-b80a-523af76d6067 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.786183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fc0b05b-ff88-45ca-b80a-523af76d6067 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.786924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fc0b05b-ff88-45ca-b80a-523af76d6067 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.787347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fc0b05b-ff88-45ca-b80a-523af76d6067 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.816769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5fc0b05b-ff88-45ca-b80a-523af76d6067 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042960 Jun 17 13:00:38.817299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 625/1364] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:38.877431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:38.878037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:38.884693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.885135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.885893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.886315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.948140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:38.956271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7551dec4-9c7b-4b7c-95f0-3525574051ff tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083091 Jun 17 13:00:38.956806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 740/1365] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:38 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:39.271988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:39.272736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:39.280712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.281204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.281966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.282386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.453805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:39.478734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3c51a369-4e38-4320-8c98-c76e2d52662f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.212797 Jun 17 13:00:39.479531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 626/1366] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:39.785271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-31a0866c-12dc-4e3a-8510-94fc225aad55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:39.789123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-31a0866c-12dc-4e3a-8510-94fc225aad55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:39.797654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a0866c-12dc-4e3a-8510-94fc225aad55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.798146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a0866c-12dc-4e3a-8510-94fc225aad55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.800289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a0866c-12dc-4e3a-8510-94fc225aad55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.801197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a0866c-12dc-4e3a-8510-94fc225aad55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.835328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3aec0dce-2877-48c5-810b-5b0df75ef9e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:39.838738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3aec0dce-2877-48c5-810b-5b0df75ef9e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:39.848988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3aec0dce-2877-48c5-810b-5b0df75ef9e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.850744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3aec0dce-2877-48c5-810b-5b0df75ef9e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.851731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3aec0dce-2877-48c5-810b-5b0df75ef9e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.852202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3aec0dce-2877-48c5-810b-5b0df75ef9e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.855969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-31a0866c-12dc-4e3a-8510-94fc225aad55 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075192 Jun 17 13:00:39.858985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 741/1367] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:39.896851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3aec0dce-2877-48c5-810b-5b0df75ef9e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070997 Jun 17 13:00:39.904346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 627/1368] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:39.973432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:39.974080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:39.980952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.981455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.982243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.982730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.069490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:40.078631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-42e21253-5a53-4812-a7f1-14ce9f65f94f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.109118 Jun 17 13:00:40.079189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 742/1369] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:39 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:40.504826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:40.505813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:40.512564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.513011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.513770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.514199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.665261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:40.673505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-329723bf-5b27-4b0d-b631-a49b6661a29c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172831 Jun 17 13:00:40.674089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 628/1370] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:40 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:40.879061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-35a4b244-2c7a-4a12-86d6-0804bf7bdc29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:40.880145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-35a4b244-2c7a-4a12-86d6-0804bf7bdc29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:40.888500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35a4b244-2c7a-4a12-86d6-0804bf7bdc29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.888944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35a4b244-2c7a-4a12-86d6-0804bf7bdc29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.889704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35a4b244-2c7a-4a12-86d6-0804bf7bdc29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.890135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-35a4b244-2c7a-4a12-86d6-0804bf7bdc29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.913100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-35036ef2-d5ea-4e77-bb45-6708e5039f89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:40.914080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-35036ef2-d5ea-4e77-bb45-6708e5039f89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:40.918867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:40.921642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35036ef2-d5ea-4e77-bb45-6708e5039f89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.922126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35036ef2-d5ea-4e77-bb45-6708e5039f89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.922996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35036ef2-d5ea-4e77-bb45-6708e5039f89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.923452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35036ef2-d5ea-4e77-bb45-6708e5039f89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.924074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-35a4b244-2c7a-4a12-86d6-0804bf7bdc29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051836 Jun 17 13:00:40.924652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 743/1371] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:40.958732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-35036ef2-d5ea-4e77-bb45-6708e5039f89 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049780 Jun 17 13:00:40.959450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 629/1372] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:41.098664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:41.099517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:41.107676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.108128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.108870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.109320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.175529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:41.183437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fb6198d2-7e64-4537-b046-9cf0ca620e27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089575 Jun 17 13:00:41.184029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 744/1373] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:41 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:41.690894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:41.691529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:41.698625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.699075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.699869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.700302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.832081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:41.840084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-80b07e2f-8cb7-44bb-8968-e09f3bb06902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.153127 Jun 17 13:00:41.840649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 630/1374] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:41.936469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-40dae2d9-3962-472c-b162-8702e228a84a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:41.937413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-40dae2d9-3962-472c-b162-8702e228a84a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:41.943838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40dae2d9-3962-472c-b162-8702e228a84a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.944222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40dae2d9-3962-472c-b162-8702e228a84a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.944973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40dae2d9-3962-472c-b162-8702e228a84a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.945506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40dae2d9-3962-472c-b162-8702e228a84a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.971147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ab68510-054c-4880-b6d3-4240e03bf1d4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:41.972078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ab68510-054c-4880-b6d3-4240e03bf1d4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:41.975970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-40dae2d9-3962-472c-b162-8702e228a84a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Jun 17 13:00:41.976963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 745/1375] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:41.979140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ab68510-054c-4880-b6d3-4240e03bf1d4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.979610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ab68510-054c-4880-b6d3-4240e03bf1d4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.980377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ab68510-054c-4880-b6d3-4240e03bf1d4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.980785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ab68510-054c-4880-b6d3-4240e03bf1d4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.012685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ab68510-054c-4880-b6d3-4240e03bf1d4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045389 Jun 17 13:00:42.013255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 631/1376] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:42.201069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:42.201580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:42.208507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.209107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.209743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.210172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.272132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:42.281811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6d17f15-ade3-4c3c-bcff-6f4843cbf89d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084865 Jun 17 13:00:42.282394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 746/1377] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:42 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:42.857590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:42.858371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:42.864751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.865195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.865961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.866390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.988814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-59d70b60-b999-46af-8c93-79776de3db4d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:42.989741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-59d70b60-b999-46af-8c93-79776de3db4d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:42.997026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59d70b60-b999-46af-8c93-79776de3db4d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.997349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59d70b60-b999-46af-8c93-79776de3db4d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.998127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59d70b60-b999-46af-8c93-79776de3db4d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.001640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:43.002603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59d70b60-b999-46af-8c93-79776de3db4d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:43.009553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-087d4277-4eea-4def-9be7-a3a31fb75201 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.155878 Jun 17 13:00:43.010128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 632/1378] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:43.024544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c6737dff-2e09-4f62-9c95-4641ac8d77b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:43.025476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c6737dff-2e09-4f62-9c95-4641ac8d77b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:43.031661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6737dff-2e09-4f62-9c95-4641ac8d77b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.032109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6737dff-2e09-4f62-9c95-4641ac8d77b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:43.032866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6737dff-2e09-4f62-9c95-4641ac8d77b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.033235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-59d70b60-b999-46af-8c93-79776de3db4d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048464 Jun 17 13:00:43.033353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6737dff-2e09-4f62-9c95-4641ac8d77b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:43.033791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 747/1379] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:00:43.050359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:43.064668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c6737dff-2e09-4f62-9c95-4641ac8d77b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043975 Jun 17 13:00:43.065239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 633/1380] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:43.299081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:43.299702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:43.306452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.306889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:43.307680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.308105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:43.373977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:43.380515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc62efeb-8521-46e5-9d95-b9252686bc24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085369 Jun 17 13:00:43.381086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 748/1381] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:43 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:44.026856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:44.027516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:44.034667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.035104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.035904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.036326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.045701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c62b2929-4101-47ec-bfc1-b2235161a285 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:44.046635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c62b2929-4101-47ec-bfc1-b2235161a285 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:44.053761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c62b2929-4101-47ec-bfc1-b2235161a285 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.054207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c62b2929-4101-47ec-bfc1-b2235161a285 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.055092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c62b2929-4101-47ec-bfc1-b2235161a285 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.055619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c62b2929-4101-47ec-bfc1-b2235161a285 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.086599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c62b2929-4101-47ec-bfc1-b2235161a285 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Jun 17 13:00:44.087505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 749/1382] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:44.091913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-de2a4893-7554-4503-91c3-2ee61619b441 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:44.092825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-de2a4893-7554-4503-91c3-2ee61619b441 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:44.098957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de2a4893-7554-4503-91c3-2ee61619b441 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.099424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de2a4893-7554-4503-91c3-2ee61619b441 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.100255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de2a4893-7554-4503-91c3-2ee61619b441 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.100615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de2a4893-7554-4503-91c3-2ee61619b441 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.135267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-de2a4893-7554-4503-91c3-2ee61619b441 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046970 Jun 17 13:00:44.136166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 750/1383] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:44.182293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:44.190480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a60b0ee3-407d-4db6-849a-bf76578067de tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167659 Jun 17 13:00:44.191066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 634/1384] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:44.401593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:44.402127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:44.408748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.409191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.409961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.410400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.479226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:44.489127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4181c5b5-4c89-421e-bdf1-105fd55750c5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091659 Jun 17 13:00:44.489713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 751/1385] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:44 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:45.098915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-205b6ecc-b380-4060-a80c-bd9fe8a18b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:45.099880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-205b6ecc-b380-4060-a80c-bd9fe8a18b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:45.106967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-205b6ecc-b380-4060-a80c-bd9fe8a18b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.107422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-205b6ecc-b380-4060-a80c-bd9fe8a18b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.108218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-205b6ecc-b380-4060-a80c-bd9fe8a18b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.108651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-205b6ecc-b380-4060-a80c-bd9fe8a18b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.140123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-205b6ecc-b380-4060-a80c-bd9fe8a18b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045252 Jun 17 13:00:45.140699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 635/1386] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:45.146571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d7a30aa2-9678-4d85-966a-7643d54d88cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:45.147533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d7a30aa2-9678-4d85-966a-7643d54d88cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:45.154526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a30aa2-9678-4d85-966a-7643d54d88cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.154982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a30aa2-9678-4d85-966a-7643d54d88cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.155784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a30aa2-9678-4d85-966a-7643d54d88cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.156214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a30aa2-9678-4d85-966a-7643d54d88cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.195246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d7a30aa2-9678-4d85-966a-7643d54d88cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052593 Jun 17 13:00:45.195860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 752/1387] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:45.210249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:45.210249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:45.218900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.219464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.220239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.220674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.360987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:45.368931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-51261b0c-fab1-4059-bfd9-e6abf43cf3bf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163363 Jun 17 13:00:45.369504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 636/1388] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:45.506743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:45.507352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:45.509262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:45.515065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.515538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.516313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.516746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.595639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:45.603678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a1d2df3-0a1b-43b8-b224-7c332d886443 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.100706 Jun 17 13:00:45.604256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 753/1389] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:45 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:46.152449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-273537f5-257d-40c1-a035-f6cf8e005a51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:46.153379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-273537f5-257d-40c1-a035-f6cf8e005a51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:46.160580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-273537f5-257d-40c1-a035-f6cf8e005a51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.161018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-273537f5-257d-40c1-a035-f6cf8e005a51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.161785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-273537f5-257d-40c1-a035-f6cf8e005a51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.162222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-273537f5-257d-40c1-a035-f6cf8e005a51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.193101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-273537f5-257d-40c1-a035-f6cf8e005a51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Jun 17 13:00:46.193655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 637/1390] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:46.208022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1a97ec5e-3331-4574-85ab-2498a3fdf651 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:46.209089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1a97ec5e-3331-4574-85ab-2498a3fdf651 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:46.216291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a97ec5e-3331-4574-85ab-2498a3fdf651 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.216737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a97ec5e-3331-4574-85ab-2498a3fdf651 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.217502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a97ec5e-3331-4574-85ab-2498a3fdf651 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.217940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a97ec5e-3331-4574-85ab-2498a3fdf651 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.248815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1a97ec5e-3331-4574-85ab-2498a3fdf651 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044729 Jun 17 13:00:46.249736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 754/1391] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:46.388345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:46.389080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:46.398289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.398780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.400031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.400467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.548585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:46.558048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eb5ec04f-071a-46c7-90c6-ead2201429fe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175327 Jun 17 13:00:46.558890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 638/1392] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:46.624086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:46.625051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:46.631659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.632102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.632865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:46.633296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.699020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:46.706816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-51c9c436-11bb-4c4a-94b6-450a2d0a3313 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086692 Jun 17 13:00:46.707383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 755/1393] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:46 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:47.205479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-90060b51-ef96-40de-8e70-5267eb287716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:47.206425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-90060b51-ef96-40de-8e70-5267eb287716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:47.213527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90060b51-ef96-40de-8e70-5267eb287716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.213871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90060b51-ef96-40de-8e70-5267eb287716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.214652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90060b51-ef96-40de-8e70-5267eb287716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.215077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90060b51-ef96-40de-8e70-5267eb287716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.245581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-90060b51-ef96-40de-8e70-5267eb287716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Jun 17 13:00:47.246149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 639/1394] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:47.262801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-391c9127-12c5-4651-9649-e5842b72a255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:47.263759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-391c9127-12c5-4651-9649-e5842b72a255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:47.270795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391c9127-12c5-4651-9649-e5842b72a255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.271232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391c9127-12c5-4651-9649-e5842b72a255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.272020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391c9127-12c5-4651-9649-e5842b72a255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.272445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391c9127-12c5-4651-9649-e5842b72a255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.302658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-391c9127-12c5-4651-9649-e5842b72a255 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044459 Jun 17 13:00:47.303205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 756/1395] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:47.577326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:47.577923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:47.586951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.588173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.588933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.589359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.723897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:47.724592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:47.730842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.731239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.732034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.732461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.733343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:47.741279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f6aab84e-a082-4f7e-9887-53422b83533b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168984 Jun 17 13:00:47.741845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 640/1396] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:47.802194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:47.815344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-06e6dc9d-ebcb-474e-8597-19348f01787a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095064 Jun 17 13:00:47.816306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 757/1397] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:47 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:48.262019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-21a4fcaf-8d70-475a-b722-6fa11361fffd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:48.263156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-21a4fcaf-8d70-475a-b722-6fa11361fffd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:48.271783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21a4fcaf-8d70-475a-b722-6fa11361fffd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.272332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21a4fcaf-8d70-475a-b722-6fa11361fffd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.273291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21a4fcaf-8d70-475a-b722-6fa11361fffd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.273828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21a4fcaf-8d70-475a-b722-6fa11361fffd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.312773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-21a4fcaf-8d70-475a-b722-6fa11361fffd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057115 Jun 17 13:00:48.313686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 641/1398] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:48.314627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9400573d-9e0e-4a20-b9e2-aab1a91c3235 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:48.315695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9400573d-9e0e-4a20-b9e2-aab1a91c3235 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:48.323399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9400573d-9e0e-4a20-b9e2-aab1a91c3235 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.323798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9400573d-9e0e-4a20-b9e2-aab1a91c3235 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.324553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9400573d-9e0e-4a20-b9e2-aab1a91c3235 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.324975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9400573d-9e0e-4a20-b9e2-aab1a91c3235 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.361923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9400573d-9e0e-4a20-b9e2-aab1a91c3235 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051457 Jun 17 13:00:48.362491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 758/1399] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:48.763853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:48.764862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:48.775146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.775954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.776982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.777416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.835052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:48.835953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:48.843384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.843861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.844623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.845052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.907187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:48.915084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8bd80b37-7031-4751-b596-91ac396ed251 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086222 Jun 17 13:00:48.915682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 759/1400] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:48 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:48.920269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:48.928245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fd33b0d1-8359-42d4-8f96-857a52d4be37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.171008 Jun 17 13:00:48.928794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 642/1401] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:49.330849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c1e83ef7-f0d7-4320-b749-b03c38ac3370 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:49.332268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c1e83ef7-f0d7-4320-b749-b03c38ac3370 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:49.342132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e83ef7-f0d7-4320-b749-b03c38ac3370 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.342581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e83ef7-f0d7-4320-b749-b03c38ac3370 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:49.343418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e83ef7-f0d7-4320-b749-b03c38ac3370 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.343831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e83ef7-f0d7-4320-b749-b03c38ac3370 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:49.360981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:49.373999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5a02182a-6f97-4716-af0e-88724694b00a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:49.375276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5a02182a-6f97-4716-af0e-88724694b00a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:49.375718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c1e83ef7-f0d7-4320-b749-b03c38ac3370 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051817 Jun 17 13:00:49.376286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 760/1402] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:49.382016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a02182a-6f97-4716-af0e-88724694b00a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.382460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a02182a-6f97-4716-af0e-88724694b00a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:49.383221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a02182a-6f97-4716-af0e-88724694b00a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.383681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a02182a-6f97-4716-af0e-88724694b00a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:49.415497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5a02182a-6f97-4716-af0e-88724694b00a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045676 Jun 17 13:00:49.416051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 643/1403] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:49.937158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:49.938156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:49.949325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.949752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:49.950517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.950658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:49.950944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:49.951097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:49.957468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.957906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:49.958682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:49.959114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:50.018237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:50.026292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47d8c42c-e7e1-4483-a172-51e7510b74d8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096164 Jun 17 13:00:50.026854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 761/1404] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:49 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:50.101618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:50.109634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a3642bfc-e18d-43a0-aa94-464ce54e5884 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164659 Jun 17 13:00:50.110177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 644/1405] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:50.389903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b8aae11e-93ad-4aee-9360-22e29a531953 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:50.390841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b8aae11e-93ad-4aee-9360-22e29a531953 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:50.397880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8aae11e-93ad-4aee-9360-22e29a531953 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:50.398326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8aae11e-93ad-4aee-9360-22e29a531953 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:50.399092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8aae11e-93ad-4aee-9360-22e29a531953 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:50.399560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8aae11e-93ad-4aee-9360-22e29a531953 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:50.427549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a12027af-c6ba-491e-9fce-9aaaa72894a8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:50.428703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a12027af-c6ba-491e-9fce-9aaaa72894a8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:50.429883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b8aae11e-93ad-4aee-9360-22e29a531953 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044617 Jun 17 13:00:50.430648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 762/1406] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:50.436629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a12027af-c6ba-491e-9fce-9aaaa72894a8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:50.437126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a12027af-c6ba-491e-9fce-9aaaa72894a8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:50.437882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a12027af-c6ba-491e-9fce-9aaaa72894a8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:50.438300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a12027af-c6ba-491e-9fce-9aaaa72894a8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:50.467794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a12027af-c6ba-491e-9fce-9aaaa72894a8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044230 Jun 17 13:00:50.468338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 645/1407] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:51.045457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:51.046248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:51.054860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.055484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.056484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.057045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.119204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:51.126647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:51.127355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:51.127859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed61dd7b-2106-43d1-9b72-8c67bbd20bc8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088149 Jun 17 13:00:51.128439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 763/1408] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:51 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:51.133553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.133982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.134727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.135147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.278324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:51.289353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef96c95a-a81e-441c-873b-de1d229051ae tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166552 Jun 17 13:00:51.290101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 646/1409] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:51.446178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e75725f2-1346-4eb9-94fd-10aec9a51b2a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:51.447652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e75725f2-1346-4eb9-94fd-10aec9a51b2a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:51.455492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75725f2-1346-4eb9-94fd-10aec9a51b2a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.455933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75725f2-1346-4eb9-94fd-10aec9a51b2a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.456700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75725f2-1346-4eb9-94fd-10aec9a51b2a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.457110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75725f2-1346-4eb9-94fd-10aec9a51b2a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.479979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4912de6d-2ddf-4e7e-ac84-cb6db9385aa9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:51.480837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4912de6d-2ddf-4e7e-ac84-cb6db9385aa9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:51.487801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4912de6d-2ddf-4e7e-ac84-cb6db9385aa9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.488241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4912de6d-2ddf-4e7e-ac84-cb6db9385aa9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.488588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e75725f2-1346-4eb9-94fd-10aec9a51b2a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049208 Jun 17 13:00:51.489421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4912de6d-2ddf-4e7e-ac84-cb6db9385aa9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.489554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 764/1410] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:51.489736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4912de6d-2ddf-4e7e-ac84-cb6db9385aa9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.520150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4912de6d-2ddf-4e7e-ac84-cb6db9385aa9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Jun 17 13:00:51.520674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 647/1411] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:00:52.144276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:52.144886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:52.151404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.151869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.152626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.153154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.214214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:52.222214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ecf773a-de74-418b-84e4-ce238b08fe6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081934 Jun 17 13:00:52.222771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 765/1412] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:52.310900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:52.311605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:52.318666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.319158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.320041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.320517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.455265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:52.463044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c0ff4fab-1210-49fe-9442-f8d49a70cda1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.157861 Jun 17 13:00:52.463632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 648/1413] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:52.502201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ddbe1e12-aa0f-4df6-8e94-7b1b4353242e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:52.503151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ddbe1e12-aa0f-4df6-8e94-7b1b4353242e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:52.510031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbe1e12-aa0f-4df6-8e94-7b1b4353242e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.510472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbe1e12-aa0f-4df6-8e94-7b1b4353242e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.511230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbe1e12-aa0f-4df6-8e94-7b1b4353242e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.512325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbe1e12-aa0f-4df6-8e94-7b1b4353242e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.532336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4b682b0c-01f3-4806-aeca-8125587b036a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:52.533276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4b682b0c-01f3-4806-aeca-8125587b036a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:52.540140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b682b0c-01f3-4806-aeca-8125587b036a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.540582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b682b0c-01f3-4806-aeca-8125587b036a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.541332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b682b0c-01f3-4806-aeca-8125587b036a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.541769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b682b0c-01f3-4806-aeca-8125587b036a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.543989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ddbe1e12-aa0f-4df6-8e94-7b1b4353242e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Jun 17 13:00:52.544743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 766/1414] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:52.571282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4b682b0c-01f3-4806-aeca-8125587b036a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043008 Jun 17 13:00:52.571881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 649/1415] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:53.238545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:53.239212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:53.246122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.246609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.247401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.247853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.320134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:53.328966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e4d1d809-25c5-4b82-96c6-da4f8ff55a15 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.094501 Jun 17 13:00:53.329522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 767/1416] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:53 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:53.481186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:53.481743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:53.484951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:53.489266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.489718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.490556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.490988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.495856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:53.556937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ba8aad9-c609-4a3f-9091-f216a90ee0a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:53.558109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ba8aad9-c609-4a3f-9091-f216a90ee0a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:53.565938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba8aad9-c609-4a3f-9091-f216a90ee0a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.566536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba8aad9-c609-4a3f-9091-f216a90ee0a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.567409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba8aad9-c609-4a3f-9091-f216a90ee0a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.567959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ba8aad9-c609-4a3f-9091-f216a90ee0a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.598644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ba8aad9-c609-4a3f-9091-f216a90ee0a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Jun 17 13:00:53.599210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 768/1417] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:53.603807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-885179f3-0bb8-4f92-94be-5ab7db7bb411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:53.604719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-885179f3-0bb8-4f92-94be-5ab7db7bb411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:53.610822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-885179f3-0bb8-4f92-94be-5ab7db7bb411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.611271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-885179f3-0bb8-4f92-94be-5ab7db7bb411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.612065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-885179f3-0bb8-4f92-94be-5ab7db7bb411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:53.612495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-885179f3-0bb8-4f92-94be-5ab7db7bb411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.630708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:53.638802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cb9c4121-691e-45e4-a282-65f8938df925 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.162400 Jun 17 13:00:53.639387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 650/1418] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:53.642576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-885179f3-0bb8-4f92-94be-5ab7db7bb411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042322 Jun 17 13:00:53.643159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 769/1419] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:54.350482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:54.351357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:54.359638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.360086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.360853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.361287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.431202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:54.439388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b6cbbe72-f651-4e51-a944-553ad12a725f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095874 Jun 17 13:00:54.439968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 651/1420] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:54 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:54.615894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1863d3e3-91a0-4355-ad42-53991e4f01da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:54.617272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1863d3e3-91a0-4355-ad42-53991e4f01da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:54.626229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1863d3e3-91a0-4355-ad42-53991e4f01da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.626672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1863d3e3-91a0-4355-ad42-53991e4f01da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.627471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1863d3e3-91a0-4355-ad42-53991e4f01da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.627898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1863d3e3-91a0-4355-ad42-53991e4f01da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.655857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:54.656431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:54.657577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1863d3e3-91a0-4355-ad42-53991e4f01da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048924 Jun 17 13:00:54.658141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 770/1421] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:54.662729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6189ae43-69f2-4309-a0fc-95308e6c8fd7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:54.663179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.663687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6189ae43-69f2-4309-a0fc-95308e6c8fd7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:54.663850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.664454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.664885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.669758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6189ae43-69f2-4309-a0fc-95308e6c8fd7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.670202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6189ae43-69f2-4309-a0fc-95308e6c8fd7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.670963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6189ae43-69f2-4309-a0fc-95308e6c8fd7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.671415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6189ae43-69f2-4309-a0fc-95308e6c8fd7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.700202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6189ae43-69f2-4309-a0fc-95308e6c8fd7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041031 Jun 17 13:00:54.700771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 771/1422] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:54.813330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:54.825632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08e5a22a-047f-4032-9624-ff68b88ddb4b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173735 Jun 17 13:00:54.826431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 652/1423] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:55.459506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:55.460054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:55.466983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.467451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.468192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.468649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.536944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:55.544988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-976952ea-3262-45da-8b55-68e3000b3e93 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091828 Jun 17 13:00:55.545590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 772/1424] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:55 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:55.672693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84a7f19d-eace-4c5f-a431-f98334cff2a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:55.673773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-84a7f19d-eace-4c5f-a431-f98334cff2a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:55.682066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84a7f19d-eace-4c5f-a431-f98334cff2a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.682584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84a7f19d-eace-4c5f-a431-f98334cff2a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.683518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84a7f19d-eace-4c5f-a431-f98334cff2a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.684001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84a7f19d-eace-4c5f-a431-f98334cff2a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.711986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a46bedb7-329e-492b-a2fc-b191ed9190c8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:55.712823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a46bedb7-329e-492b-a2fc-b191ed9190c8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:55.716430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-84a7f19d-eace-4c5f-a431-f98334cff2a5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049371 Jun 17 13:00:55.717003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 653/1425] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:55.719497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a46bedb7-329e-492b-a2fc-b191ed9190c8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.719937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a46bedb7-329e-492b-a2fc-b191ed9190c8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.720695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a46bedb7-329e-492b-a2fc-b191ed9190c8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.721120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a46bedb7-329e-492b-a2fc-b191ed9190c8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.751949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a46bedb7-329e-492b-a2fc-b191ed9190c8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043985 Jun 17 13:00:55.752502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 773/1426] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:55.852312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:55.853162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:55.860823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.861273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.862037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.862472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.002974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:56.014397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-da0bcb5b-6b71-4948-855e-cb375af1abf1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.168348 Jun 17 13:00:56.015184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 654/1427] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:56.566269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:56.567362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:56.576862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.577313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.578075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.578509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.646810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:56.655674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ac22ead0-eec4-458b-84bb-58605fd0ba1b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096174 Jun 17 13:00:56.656221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 774/1428] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:56 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:56.732638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c0aca8f6-e952-435f-bade-519e62165134 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:56.734148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c0aca8f6-e952-435f-bade-519e62165134 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:56.745444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0aca8f6-e952-435f-bade-519e62165134 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.746179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0aca8f6-e952-435f-bade-519e62165134 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.747498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0aca8f6-e952-435f-bade-519e62165134 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.747937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0aca8f6-e952-435f-bade-519e62165134 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.764314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2ec696ee-bfa0-4e60-b33d-a354905e2da7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:56.766236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2ec696ee-bfa0-4e60-b33d-a354905e2da7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:56.773764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec696ee-bfa0-4e60-b33d-a354905e2da7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.774237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec696ee-bfa0-4e60-b33d-a354905e2da7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.775000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec696ee-bfa0-4e60-b33d-a354905e2da7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.775437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec696ee-bfa0-4e60-b33d-a354905e2da7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.778090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c0aca8f6-e952-435f-bade-519e62165134 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052250 Jun 17 13:00:56.778917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 655/1429] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:56.806336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2ec696ee-bfa0-4e60-b33d-a354905e2da7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046333 Jun 17 13:00:56.806866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 775/1430] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:57.041040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:57.042022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:57.053341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.054100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.055358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.056250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.196868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:57.205366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2ea214fa-8519-4450-b542-ea3fda7c560a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.171106 Jun 17 13:00:57.205946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 656/1431] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:57.676685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:57.677778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:57.687911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.688573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.689709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.690343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.761378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:57.769230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ab44309f-ea02-4723-be83-be64a7157013 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.099088 Jun 17 13:00:57.769778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 776/1432] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:57 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:57.790035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5f9af2fc-74ea-4593-925d-f856fba6784e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:57.790957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5f9af2fc-74ea-4593-925d-f856fba6784e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:57.797809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9af2fc-74ea-4593-925d-f856fba6784e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.798250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9af2fc-74ea-4593-925d-f856fba6784e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.799003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9af2fc-74ea-4593-925d-f856fba6784e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.799457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9af2fc-74ea-4593-925d-f856fba6784e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.818399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9bbc0022-df69-4737-af74-c451d3e5160a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:57.819314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9bbc0022-df69-4737-af74-c451d3e5160a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:57.826295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bbc0022-df69-4737-af74-c451d3e5160a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.826846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bbc0022-df69-4737-af74-c451d3e5160a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.827685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bbc0022-df69-4737-af74-c451d3e5160a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.828121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bbc0022-df69-4737-af74-c451d3e5160a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.828755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5f9af2fc-74ea-4593-925d-f856fba6784e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Jun 17 13:00:57.829540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 657/1433] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:57.831922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:57.859184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9bbc0022-df69-4737-af74-c451d3e5160a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044761 Jun 17 13:00:57.859734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 777/1434] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:58.226861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:58.227905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:58.238220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.238968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.240381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.241101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.379923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:58.387703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c6d52a59-ff7b-4687-a90e-5d958e3ca928 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167401 Jun 17 13:00:58.388260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 658/1435] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:58.790797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:58.791862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:58.799889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.800356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.801125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.801561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.842081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6f17c168-88ef-403a-9601-53580dd150fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:58.843073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6f17c168-88ef-403a-9601-53580dd150fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:58.850215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f17c168-88ef-403a-9601-53580dd150fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.850661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f17c168-88ef-403a-9601-53580dd150fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.851466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f17c168-88ef-403a-9601-53580dd150fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.851887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f17c168-88ef-403a-9601-53580dd150fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.865998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:58.873989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d51d06cc-0652-4d01-b8b9-7f583c584460 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089974 Jun 17 13:00:58.874555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 778/1436] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:58 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:58.879709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-965dce60-cbe7-403c-b5e9-e2e7f65512c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:58.880639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-965dce60-cbe7-403c-b5e9-e2e7f65512c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:58.882178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6f17c168-88ef-403a-9601-53580dd150fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Jun 17 13:00:58.883867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 659/1437] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:58.886862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-965dce60-cbe7-403c-b5e9-e2e7f65512c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.887315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-965dce60-cbe7-403c-b5e9-e2e7f65512c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.888125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-965dce60-cbe7-403c-b5e9-e2e7f65512c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:58.888556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-965dce60-cbe7-403c-b5e9-e2e7f65512c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:58.918393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-965dce60-cbe7-403c-b5e9-e2e7f65512c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042804 Jun 17 13:00:58.918940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 779/1438] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:59.410106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:59.410972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:59.421608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.422061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.422808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.423231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.571235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:59.581298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e8cf6fc5-bef3-4e3b-91d5-00f375ac1a8a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.178586 Jun 17 13:00:59.581869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 660/1439] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:59 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:59.892335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:59.892959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:59.893482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-80bb3fec-a216-4b82-9704-6371c0117360 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:59.894419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-80bb3fec-a216-4b82-9704-6371c0117360 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:59.900201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.900650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.901414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.901522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80bb3fec-a216-4b82-9704-6371c0117360 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.901845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.901957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80bb3fec-a216-4b82-9704-6371c0117360 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.902742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80bb3fec-a216-4b82-9704-6371c0117360 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.903200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80bb3fec-a216-4b82-9704-6371c0117360 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.935159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-80bb3fec-a216-4b82-9704-6371c0117360 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Jun 17 13:00:59.935766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 661/1440] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:00:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:59.940967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6c71cb19-b1ec-4b6b-a238-be6648f15315 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:59.941877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6c71cb19-b1ec-4b6b-a238-be6648f15315 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:59.948293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c71cb19-b1ec-4b6b-a238-be6648f15315 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.948778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c71cb19-b1ec-4b6b-a238-be6648f15315 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.949578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c71cb19-b1ec-4b6b-a238-be6648f15315 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.950007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c71cb19-b1ec-4b6b-a238-be6648f15315 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.976713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:59.981511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6c71cb19-b1ec-4b6b-a238-be6648f15315 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044549 Jun 17 13:00:59.982114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 662/1441] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:00:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:00:59.985154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7b63f560-24ec-45fa-8f65-4744dcbc7530 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.096842 Jun 17 13:00:59.985748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 780/1442] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:59 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:00.603472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:00.604033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:00.610662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.611301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.612502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.612943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.707442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:00.707963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:00.715495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.715936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.716716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.717134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.745690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:00.753624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b4b35ebd-5ece-4adc-9fcb-e57a0785de41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.154159 Jun 17 13:01:00.754183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 663/1443] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:00.951147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4a44644b-5bbc-4db8-9603-f823de84ca7a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:00.952129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4a44644b-5bbc-4db8-9603-f823de84ca7a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:00.959048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a44644b-5bbc-4db8-9603-f823de84ca7a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.959523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a44644b-5bbc-4db8-9603-f823de84ca7a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.960279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a44644b-5bbc-4db8-9603-f823de84ca7a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.960707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a44644b-5bbc-4db8-9603-f823de84ca7a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.991395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4a44644b-5bbc-4db8-9603-f823de84ca7a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Jun 17 13:01:00.991961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 664/1444] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:00.996417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-97dc8449-57c6-4a10-a72c-59948fb6ff16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:00.997300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-97dc8449-57c6-4a10-a72c-59948fb6ff16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:01.004103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97dc8449-57c6-4a10-a72c-59948fb6ff16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:01.004515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97dc8449-57c6-4a10-a72c-59948fb6ff16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:01.005291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97dc8449-57c6-4a10-a72c-59948fb6ff16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:01.005714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97dc8449-57c6-4a10-a72c-59948fb6ff16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:01.034878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-97dc8449-57c6-4a10-a72c-59948fb6ff16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041913 Jun 17 13:01:01.035429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 665/1445] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:01.039771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:01.040354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:01.046671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:01.047110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:01.047893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:01.048312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:01.119671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:01.123148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:01.129543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-afffabdc-60be-4eaa-8623-4370173e9559 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.093138 Jun 17 13:01:01.130059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 666/1446] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:01 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:01.774771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:01.775857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:01.786164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:01.786914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:01.788227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:01.788945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:01.927470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:01.938499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4bffc7e4-8604-4177-b558-249dc486cd76 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170613 Jun 17 13:01:01.939091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 667/1447] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:02.002366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b5f80f6e-36c8-444b-96bd-63605e612ea7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:02.003287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b5f80f6e-36c8-444b-96bd-63605e612ea7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:02.009933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5f80f6e-36c8-444b-96bd-63605e612ea7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.010419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5f80f6e-36c8-444b-96bd-63605e612ea7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:02.011180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5f80f6e-36c8-444b-96bd-63605e612ea7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.011646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5f80f6e-36c8-444b-96bd-63605e612ea7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:02.043149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b5f80f6e-36c8-444b-96bd-63605e612ea7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Jun 17 13:01:02.044830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 668/1448] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:02.048876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b03a61d-4df1-440c-a119-320a60ba87a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:02.049782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b03a61d-4df1-440c-a119-320a60ba87a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:02.056314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b03a61d-4df1-440c-a119-320a60ba87a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.056751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b03a61d-4df1-440c-a119-320a60ba87a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:02.057555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b03a61d-4df1-440c-a119-320a60ba87a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.058128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b03a61d-4df1-440c-a119-320a60ba87a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:02.088288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b03a61d-4df1-440c-a119-320a60ba87a5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043669 Jun 17 13:01:02.088847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 669/1449] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:02.149820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:02.150424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:02.157214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.157676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:02.158444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.158880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:02.232267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:02.244002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71404aac-422d-4062-b227-e03851057fb2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.097835 Jun 17 13:01:02.244753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 670/1450] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:02 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:02.957552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:02.958156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:02.964770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.965214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:02.965970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:02.966400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.098865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:03.106891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b4903122-8b12-423a-8b0f-1bb64cfdd2f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.154408 Jun 17 13:01:03.107478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 671/1451] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:03.112212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-55807706-6bfe-48fd-8574-14c381071a6a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:03.113133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-55807706-6bfe-48fd-8574-14c381071a6a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:03.121119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55807706-6bfe-48fd-8574-14c381071a6a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:03.121556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55807706-6bfe-48fd-8574-14c381071a6a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.122306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55807706-6bfe-48fd-8574-14c381071a6a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:03.122726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55807706-6bfe-48fd-8574-14c381071a6a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.153186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-55807706-6bfe-48fd-8574-14c381071a6a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Jun 17 13:01:03.153735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 672/1452] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:03.158544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-082f8f37-11c9-440d-a65c-f6d1ab7da859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:03.159408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-082f8f37-11c9-440d-a65c-f6d1ab7da859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:03.164993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-082f8f37-11c9-440d-a65c-f6d1ab7da859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:03.165424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-082f8f37-11c9-440d-a65c-f6d1ab7da859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.166159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-082f8f37-11c9-440d-a65c-f6d1ab7da859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:03.166577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-082f8f37-11c9-440d-a65c-f6d1ab7da859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.194871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-082f8f37-11c9-440d-a65c-f6d1ab7da859 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040168 Jun 17 13:01:03.195404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 673/1453] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:03.263819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:03.264684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:03.271534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:03.271969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.272713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:03.273130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.345958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:03.353718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e9624766-0eb9-4f57-8ff8-e7cbd9724276 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095870 Jun 17 13:01:03.354282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 674/1454] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:03 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:01:04.128951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:04.129995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:04.141209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.141652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.142450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.142882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.291532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:04.302418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81be7ec0-337d-407e-9ebc-05f8e2d293a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.180682 Jun 17 13:01:04.303013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 675/1455] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:04.308843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cc307ce7-1633-4650-a6df-b1a032edabcc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:04.310352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cc307ce7-1633-4650-a6df-b1a032edabcc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:04.317433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc307ce7-1633-4650-a6df-b1a032edabcc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.317875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc307ce7-1633-4650-a6df-b1a032edabcc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.318643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc307ce7-1633-4650-a6df-b1a032edabcc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.319066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc307ce7-1633-4650-a6df-b1a032edabcc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.348902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cc307ce7-1633-4650-a6df-b1a032edabcc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Jun 17 13:01:04.349461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 676/1456] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:04.354028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3f1739ea-cb22-48f0-ab91-1adb95b1543e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:04.354928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3f1739ea-cb22-48f0-ab91-1adb95b1543e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:04.361356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f1739ea-cb22-48f0-ab91-1adb95b1543e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.361800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f1739ea-cb22-48f0-ab91-1adb95b1543e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.362545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f1739ea-cb22-48f0-ab91-1adb95b1543e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.362972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f1739ea-cb22-48f0-ab91-1adb95b1543e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.393273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3f1739ea-cb22-48f0-ab91-1adb95b1543e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042740 Jun 17 13:01:04.393740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 677/1457] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:04.397998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:04.398585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:04.404330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.404769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.405519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:04.405988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:04.467629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:04.476104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ae256f2-67bc-4c78-839a-1aa1203caea3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081452 Jun 17 13:01:04.476662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 678/1458] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:04 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:05.322732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:05.323491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:05.330668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.331108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.332084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.332635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.492708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:05.502138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0e7002c1-e540-4b0d-bd73-0a6bcbcd7695 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.183361 Jun 17 13:01:05.502748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 679/1459] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:05.507463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cbcd7243-fafc-4c7d-8ba7-33d4221ed1d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:05.508371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cbcd7243-fafc-4c7d-8ba7-33d4221ed1d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:05.518349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cbcd7243-fafc-4c7d-8ba7-33d4221ed1d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.518783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cbcd7243-fafc-4c7d-8ba7-33d4221ed1d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.519569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cbcd7243-fafc-4c7d-8ba7-33d4221ed1d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.519992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cbcd7243-fafc-4c7d-8ba7-33d4221ed1d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.549184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cbcd7243-fafc-4c7d-8ba7-33d4221ed1d9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Jun 17 13:01:05.549723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 680/1460] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:05.554150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c3045994-3815-45be-8503-b4e616442583 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:05.555024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c3045994-3815-45be-8503-b4e616442583 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:05.563809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3045994-3815-45be-8503-b4e616442583 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.564242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3045994-3815-45be-8503-b4e616442583 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.564979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3045994-3815-45be-8503-b4e616442583 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.565398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3045994-3815-45be-8503-b4e616442583 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.594979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c3045994-3815-45be-8503-b4e616442583 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Jun 17 13:01:05.595552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 681/1461] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:05.599777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:05.600380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:05.606824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.607257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.608025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:05.608446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:05.675973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:05.683836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c00ddbad-56bc-46a1-b438-03474cc57f24 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087338 Jun 17 13:01:05.684358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 682/1462] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:05 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:06.521418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:06.522126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:06.529019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.529469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.530230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.530666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.549123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:06.669753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:06.677723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-967a5667-6a3d-462a-875b-cd9605fb1369 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160252 Jun 17 13:01:06.678255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 683/1463] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:06.682711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6d47d606-016e-4e8b-8656-6200ad5665c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:06.683792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6d47d606-016e-4e8b-8656-6200ad5665c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:06.691633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d47d606-016e-4e8b-8656-6200ad5665c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.692075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d47d606-016e-4e8b-8656-6200ad5665c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.692911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d47d606-016e-4e8b-8656-6200ad5665c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.693338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d47d606-016e-4e8b-8656-6200ad5665c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.723803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6d47d606-016e-4e8b-8656-6200ad5665c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Jun 17 13:01:06.724305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 684/1464] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:06.728760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a86bf510-278c-4d9a-8db8-7470d70fa854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:06.729717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a86bf510-278c-4d9a-8db8-7470d70fa854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:06.736045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a86bf510-278c-4d9a-8db8-7470d70fa854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.736484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a86bf510-278c-4d9a-8db8-7470d70fa854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.737225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a86bf510-278c-4d9a-8db8-7470d70fa854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.737647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a86bf510-278c-4d9a-8db8-7470d70fa854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.767938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a86bf510-278c-4d9a-8db8-7470d70fa854 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042624 Jun 17 13:01:06.768733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 685/1465] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:06.773095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:06.773680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:06.779944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.780390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.781146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:06.781930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:06.847033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:06.855037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1464d63e-20b1-4889-ba93-855b939036bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085359 Jun 17 13:01:06.855636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 686/1466] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:06 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:07.694618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:07.695328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:07.702187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.702624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:07.703499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.703933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:07.860474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:07.872489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cb1caf70-f643-41e7-8175-91128d7a55ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.181575 Jun 17 13:01:07.873280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 687/1467] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:07.880662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-79da3cce-b9f7-46a1-9245-7c2e6d25b514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:07.882124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-79da3cce-b9f7-46a1-9245-7c2e6d25b514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:07.891755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79da3cce-b9f7-46a1-9245-7c2e6d25b514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.892224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79da3cce-b9f7-46a1-9245-7c2e6d25b514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:07.893203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79da3cce-b9f7-46a1-9245-7c2e6d25b514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.893475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79da3cce-b9f7-46a1-9245-7c2e6d25b514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:07.927435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-79da3cce-b9f7-46a1-9245-7c2e6d25b514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052616 Jun 17 13:01:07.928234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 688/1468] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:07.933059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d21d9420-0221-42b3-abe4-47a7d12fb5cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:07.933970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d21d9420-0221-42b3-abe4-47a7d12fb5cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:07.940952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21d9420-0221-42b3-abe4-47a7d12fb5cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.941392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21d9420-0221-42b3-abe4-47a7d12fb5cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:07.942159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21d9420-0221-42b3-abe4-47a7d12fb5cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.942588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21d9420-0221-42b3-abe4-47a7d12fb5cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:07.976740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d21d9420-0221-42b3-abe4-47a7d12fb5cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047259 Jun 17 13:01:07.977223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 689/1469] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:07.981755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:07.982360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:07.988788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.989230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:07.989996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:07.990436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:08.055044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:08.064662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f2b633d4-2c6f-41ca-9757-b7a8ee8828e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086432 Jun 17 13:01:08.065272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 690/1470] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:07 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:08.897083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:08.897911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:08.913705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:08.914162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:08.914960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:08.915412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:09.058719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:09.072040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-80eb70f8-8d05-4a14-9687-f2f9536b6c0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.180115 Jun 17 13:01:09.072653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 691/1471] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:09.077583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4eb1362c-b446-4836-baee-3d973b7b2f5b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:09.078790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4eb1362c-b446-4836-baee-3d973b7b2f5b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:09.087294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eb1362c-b446-4836-baee-3d973b7b2f5b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:09.087846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eb1362c-b446-4836-baee-3d973b7b2f5b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:09.088624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eb1362c-b446-4836-baee-3d973b7b2f5b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:09.089054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eb1362c-b446-4836-baee-3d973b7b2f5b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:09.120208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4eb1362c-b446-4836-baee-3d973b7b2f5b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046472 Jun 17 13:01:09.120815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 692/1472] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:09.125535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bad415f9-03d0-4969-bc17-5da5efc131fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:09.126814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bad415f9-03d0-4969-bc17-5da5efc131fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:09.133225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bad415f9-03d0-4969-bc17-5da5efc131fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:09.133680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bad415f9-03d0-4969-bc17-5da5efc131fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:09.134444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bad415f9-03d0-4969-bc17-5da5efc131fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:09.134878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bad415f9-03d0-4969-bc17-5da5efc131fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:09.165850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bad415f9-03d0-4969-bc17-5da5efc131fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043813 Jun 17 13:01:09.166336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 693/1473] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:09.170943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:09.171588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:09.178384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:09.178843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:09.179650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:09.180079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:09.244440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:09.253394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fd4dfef9-0ad8-4704-af3c-310d96befe27 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086071 Jun 17 13:01:09.253956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 694/1474] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:09 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:10.090401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:10.091101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:10.098090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.098528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.099255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.100000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.235488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:10.243305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f04a9bae-9494-470f-b2df-a20a14b82ab2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.156866 Jun 17 13:01:10.243949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 695/1475] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:10 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:10.248408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2f56059a-e75b-4c07-a6be-fa9921e1f22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:10.249304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2f56059a-e75b-4c07-a6be-fa9921e1f22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:10.255494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f56059a-e75b-4c07-a6be-fa9921e1f22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.255955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f56059a-e75b-4c07-a6be-fa9921e1f22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.256705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f56059a-e75b-4c07-a6be-fa9921e1f22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.257131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f56059a-e75b-4c07-a6be-fa9921e1f22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.286832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2f56059a-e75b-4c07-a6be-fa9921e1f22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 Jun 17 13:01:10.287405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 696/1476] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:10.291946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8de92ad7-026d-4588-b168-edae33523310 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:10.292832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8de92ad7-026d-4588-b168-edae33523310 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:10.298501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8de92ad7-026d-4588-b168-edae33523310 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.298938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8de92ad7-026d-4588-b168-edae33523310 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.299715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8de92ad7-026d-4588-b168-edae33523310 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.300145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8de92ad7-026d-4588-b168-edae33523310 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.328887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8de92ad7-026d-4588-b168-edae33523310 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040460 Jun 17 13:01:10.329545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 697/1477] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:10.333783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:10.334372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:10.339929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.340366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.341108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:10.341535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:10.423974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:10.432381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ac4321a-a2f2-4cb0-ab66-93309312531f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.101911 Jun 17 13:01:10.432948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 698/1478] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:10 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:10.712348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=57 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:10.736523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=26 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:11.262055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:11.262716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:11.272316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.272897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.273983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.274543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.424229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:11.436215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-96f78498-d5ab-49ff-9b85-3070e6c06f74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.178103 Jun 17 13:01:11.437099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 699/1479] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:11.441812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ddd56a41-0f86-4e93-a003-83841b9fda66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:11.442736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ddd56a41-0f86-4e93-a003-83841b9fda66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:11.445570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:11.451162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddd56a41-0f86-4e93-a003-83841b9fda66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.451918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddd56a41-0f86-4e93-a003-83841b9fda66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.452766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddd56a41-0f86-4e93-a003-83841b9fda66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.453195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddd56a41-0f86-4e93-a003-83841b9fda66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.457762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:11.484433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ddd56a41-0f86-4e93-a003-83841b9fda66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046293 Jun 17 13:01:11.484996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 700/1480] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:11.490235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-06cb596c-f2da-4781-b7e1-b9ee71c5e5ac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:11.491450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-06cb596c-f2da-4781-b7e1-b9ee71c5e5ac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:11.498074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06cb596c-f2da-4781-b7e1-b9ee71c5e5ac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.498659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06cb596c-f2da-4781-b7e1-b9ee71c5e5ac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.499896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06cb596c-f2da-4781-b7e1-b9ee71c5e5ac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.500574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06cb596c-f2da-4781-b7e1-b9ee71c5e5ac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.536172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-06cb596c-f2da-4781-b7e1-b9ee71c5e5ac tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050040 Jun 17 13:01:11.536725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 701/1481] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:11.541074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:11.541676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:11.547749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.548203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.548961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:11.549397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:11.610627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:11.618490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fa37dd1f-200b-4a7a-80af-6c670ae6b5b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080795 Jun 17 13:01:11.619061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 702/1482] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:11 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:12.459492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:12.460521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:12.470956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.471412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.472190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.472620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.607927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:12.615878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4e3e304f-fe8f-44fb-bf3e-8b6246ec03d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163165 Jun 17 13:01:12.616441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 703/1483] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:12.620959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-69e0fee5-9851-41b3-bdc7-e12bcf146eb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:12.621869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-69e0fee5-9851-41b3-bdc7-e12bcf146eb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:12.628442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e0fee5-9851-41b3-bdc7-e12bcf146eb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.628888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e0fee5-9851-41b3-bdc7-e12bcf146eb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.629677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e0fee5-9851-41b3-bdc7-e12bcf146eb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.630104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69e0fee5-9851-41b3-bdc7-e12bcf146eb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.658881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-69e0fee5-9851-41b3-bdc7-e12bcf146eb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Jun 17 13:01:12.659442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 704/1484] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:12.663917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08184547-47bc-4412-9912-c7a21fd837d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:12.664799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08184547-47bc-4412-9912-c7a21fd837d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:12.670823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08184547-47bc-4412-9912-c7a21fd837d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.671266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08184547-47bc-4412-9912-c7a21fd837d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.672042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08184547-47bc-4412-9912-c7a21fd837d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.672481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08184547-47bc-4412-9912-c7a21fd837d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.701562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08184547-47bc-4412-9912-c7a21fd837d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041096 Jun 17 13:01:12.702098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 705/1485] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:12.706612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:12.707241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:12.713118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.713498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.714216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:12.714681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:12.774607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:12.782858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-87282234-de11-4972-bcb0-f20c24ab4956 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.079833 Jun 17 13:01:12.783401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 706/1486] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:12 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:13.637377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:13.638297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:13.646855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.647301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.648091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.648518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.777988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:13.785678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c767c6af-5018-4a66-93f8-3af164c78bd3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.155216 Jun 17 13:01:13.786239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 707/1487] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:13.790816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-19a3fe4d-451e-4729-924b-3a7fc12c8289 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:13.791760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-19a3fe4d-451e-4729-924b-3a7fc12c8289 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:13.798179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19a3fe4d-451e-4729-924b-3a7fc12c8289 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.798620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19a3fe4d-451e-4729-924b-3a7fc12c8289 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.799396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19a3fe4d-451e-4729-924b-3a7fc12c8289 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.799832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19a3fe4d-451e-4729-924b-3a7fc12c8289 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.829487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-19a3fe4d-451e-4729-924b-3a7fc12c8289 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Jun 17 13:01:13.830053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 708/1488] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:13.834530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6768c7e6-5d34-4e94-a155-96cea4021c0a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:13.835412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6768c7e6-5d34-4e94-a155-96cea4021c0a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:13.841556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6768c7e6-5d34-4e94-a155-96cea4021c0a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.841997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6768c7e6-5d34-4e94-a155-96cea4021c0a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.842746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6768c7e6-5d34-4e94-a155-96cea4021c0a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.843178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6768c7e6-5d34-4e94-a155-96cea4021c0a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.871858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6768c7e6-5d34-4e94-a155-96cea4021c0a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040792 Jun 17 13:01:13.872402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 709/1489] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:13.876986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:13.877579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:13.883235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.883719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.884459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:13.884911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:13.958244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:13.966413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2b46085-b786-4c61-ad2c-c158f3bf9759 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.093095 Jun 17 13:01:13.966974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 710/1490] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:13 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:14.807618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:14.808702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:14.817682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:14.818130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:14.818895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:14.819330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:14.950009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:14.957746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d81bc58e-e1a2-48b9-9a57-486b86a29867 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.156693 Jun 17 13:01:14.958316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 711/1491] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:14.962870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5f57ccaf-1934-4bb7-b3d2-7980de4a47f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:14.963848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5f57ccaf-1934-4bb7-b3d2-7980de4a47f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:14.969679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f57ccaf-1934-4bb7-b3d2-7980de4a47f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:14.970274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f57ccaf-1934-4bb7-b3d2-7980de4a47f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:14.971037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f57ccaf-1934-4bb7-b3d2-7980de4a47f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:14.971499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f57ccaf-1934-4bb7-b3d2-7980de4a47f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:15.001742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5f57ccaf-1934-4bb7-b3d2-7980de4a47f3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Jun 17 13:01:15.002437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 712/1492] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:15.006754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0b28b30-858c-465d-9f27-2dfe47c37ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:15.007690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0b28b30-858c-465d-9f27-2dfe47c37ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:15.013893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0b28b30-858c-465d-9f27-2dfe47c37ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:15.014337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0b28b30-858c-465d-9f27-2dfe47c37ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:15.015096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0b28b30-858c-465d-9f27-2dfe47c37ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:15.015574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0b28b30-858c-465d-9f27-2dfe47c37ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:15.044074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0b28b30-858c-465d-9f27-2dfe47c37ca9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040874 Jun 17 13:01:15.044608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 713/1493] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:15.048913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:15.049489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:15.055428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:15.055901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:15.056653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:15.057079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:15.120709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:15.130939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-41dd7d5e-ef78-4bd9-8307-bc9a18d27767 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085089 Jun 17 13:01:15.131931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 714/1494] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:15 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:15.979453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:15.980548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:15.989686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:15.990159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:15.990925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:15.991360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:16.334575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:16.342753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d3d33f8b-368a-4beb-b055-dccdd5230b2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.369845 Jun 17 13:01:16.343322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 715/1495] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:16.348455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4deb53d5-9532-4bb4-9857-ae6c37a72ec7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:16.349374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4deb53d5-9532-4bb4-9857-ae6c37a72ec7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:16.355394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4deb53d5-9532-4bb4-9857-ae6c37a72ec7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:16.355866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4deb53d5-9532-4bb4-9857-ae6c37a72ec7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:16.356631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4deb53d5-9532-4bb4-9857-ae6c37a72ec7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:16.357068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4deb53d5-9532-4bb4-9857-ae6c37a72ec7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:16.383922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:16.389063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4deb53d5-9532-4bb4-9857-ae6c37a72ec7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Jun 17 13:01:16.389623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 716/1496] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:16.394136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ccacc2ef-1c74-4d30-b1b6-8318cfc67b76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:16.395026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ccacc2ef-1c74-4d30-b1b6-8318cfc67b76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:16.400957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ccacc2ef-1c74-4d30-b1b6-8318cfc67b76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:16.401401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ccacc2ef-1c74-4d30-b1b6-8318cfc67b76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:16.402156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ccacc2ef-1c74-4d30-b1b6-8318cfc67b76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:16.402589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ccacc2ef-1c74-4d30-b1b6-8318cfc67b76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:16.431986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ccacc2ef-1c74-4d30-b1b6-8318cfc67b76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041259 Jun 17 13:01:16.432542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 717/1497] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:16.436935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:16.437558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:16.443651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:16.444093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:16.444838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:16.445269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:16.506062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:16.514055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ee3647a-5f2d-4630-97c0-4929d047c1cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080531 Jun 17 13:01:16.514618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 718/1498] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:16 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:17.363136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:17.364042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:17.372158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.372607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.373503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.374016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.516405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:17.524518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-14422d1f-5781-4a54-a685-975f626a8645 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.167103 Jun 17 13:01:17.525063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 719/1499] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:17.529887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-db97dc3a-5687-4b29-9520-b1f1ea07392e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:17.530803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-db97dc3a-5687-4b29-9520-b1f1ea07392e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:17.537172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db97dc3a-5687-4b29-9520-b1f1ea07392e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.537616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db97dc3a-5687-4b29-9520-b1f1ea07392e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.538350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db97dc3a-5687-4b29-9520-b1f1ea07392e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.538793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db97dc3a-5687-4b29-9520-b1f1ea07392e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.567812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-db97dc3a-5687-4b29-9520-b1f1ea07392e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041685 Jun 17 13:01:17.568370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 720/1500] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:17.572926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-50683da7-e83c-43eb-8744-cc64036787ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:17.573797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-50683da7-e83c-43eb-8744-cc64036787ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:17.580029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50683da7-e83c-43eb-8744-cc64036787ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.580476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50683da7-e83c-43eb-8744-cc64036787ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.581232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50683da7-e83c-43eb-8744-cc64036787ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.581667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50683da7-e83c-43eb-8744-cc64036787ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.610555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-50683da7-e83c-43eb-8744-cc64036787ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041193 Jun 17 13:01:17.611162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 721/1501] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:17.615409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:17.616035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:17.622039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.622533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.623206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:17.623667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:17.690509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:17.704181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c9117645-44d0-415e-8305-0ca6c4d20497 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091809 Jun 17 13:01:17.705154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 722/1502] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:17 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:18.542476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:18.543144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:18.550188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.550631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.551408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.551844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.702089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:18.709773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aed9dc9c-8a91-42ca-a7fa-22c802aa305b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.171249 Jun 17 13:01:18.710343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 723/1503] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:18.714833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8c464541-2534-48f8-8f51-84126af0683e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:18.715779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8c464541-2534-48f8-8f51-84126af0683e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:18.722492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c464541-2534-48f8-8f51-84126af0683e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.722944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c464541-2534-48f8-8f51-84126af0683e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.723747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c464541-2534-48f8-8f51-84126af0683e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.724179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c464541-2534-48f8-8f51-84126af0683e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.753574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8c464541-2534-48f8-8f51-84126af0683e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Jun 17 13:01:18.754129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 724/1504] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:18.758542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4021df0-d591-45ba-9668-df6442b858b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:18.759416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4021df0-d591-45ba-9668-df6442b858b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:18.765445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4021df0-d591-45ba-9668-df6442b858b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.765894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4021df0-d591-45ba-9668-df6442b858b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.766646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4021df0-d591-45ba-9668-df6442b858b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.767129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4021df0-d591-45ba-9668-df6442b858b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.796910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4021df0-d591-45ba-9668-df6442b858b4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041746 Jun 17 13:01:18.797365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 725/1505] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:18.801648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:18.802239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:18.808215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.808664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.809436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:18.809870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:18.869425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:18.877459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9062f2f4-1175-46c0-be20-97df8c6a3a8d tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.079182 Jun 17 13:01:18.878183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 726/1506] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:18 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:19.733679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:19.734786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:19.742805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:19.743256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:19.744055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:19.744487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:19.888859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:19.896959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6f9a8ad6-c4c3-4525-9eb1-146a0b32a1e3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169793 Jun 17 13:01:19.897531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 727/1507] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:19.902323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a79b9ce-861b-4b2a-a1eb-45297b10a070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:19.903250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a79b9ce-861b-4b2a-a1eb-45297b10a070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:19.909860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a79b9ce-861b-4b2a-a1eb-45297b10a070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:19.910308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a79b9ce-861b-4b2a-a1eb-45297b10a070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:19.911079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a79b9ce-861b-4b2a-a1eb-45297b10a070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:19.911545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a79b9ce-861b-4b2a-a1eb-45297b10a070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:19.942897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a79b9ce-861b-4b2a-a1eb-45297b10a070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Jun 17 13:01:19.943454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 728/1508] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:19.948324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b564c37-a192-4159-b79f-f312fb0b2230 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:19.949234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b564c37-a192-4159-b79f-f312fb0b2230 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:19.955122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b564c37-a192-4159-b79f-f312fb0b2230 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:19.955622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b564c37-a192-4159-b79f-f312fb0b2230 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:19.956381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b564c37-a192-4159-b79f-f312fb0b2230 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:19.956819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b564c37-a192-4159-b79f-f312fb0b2230 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:19.988854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b564c37-a192-4159-b79f-f312fb0b2230 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044280 Jun 17 13:01:19.989332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 729/1509] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:19.993653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:19.994251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:20.000442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:20.000894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:20.002365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:20.002798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:20.064844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:20.072818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a4db9770-5c33-438c-8497-abf85a239e32 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082508 Jun 17 13:01:20.073364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 730/1510] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:19 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:20.918364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:20.919466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:20.930989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:20.931793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:20.933055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:20.933779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:21.074854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:21.083607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fba20d6c-e1d3-4687-9526-fbf85442f068 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.171643 Jun 17 13:01:21.084172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 731/1511] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:20 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:21.088717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-004dde68-fa4d-4ea5-9846-a9f08ee46576 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:21.089656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-004dde68-fa4d-4ea5-9846-a9f08ee46576 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:21.095638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-004dde68-fa4d-4ea5-9846-a9f08ee46576 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:21.096102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-004dde68-fa4d-4ea5-9846-a9f08ee46576 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:21.096865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-004dde68-fa4d-4ea5-9846-a9f08ee46576 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:21.097298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-004dde68-fa4d-4ea5-9846-a9f08ee46576 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:21.128003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-004dde68-fa4d-4ea5-9846-a9f08ee46576 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Jun 17 13:01:21.128567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 732/1512] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:21.133245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5faf81df-e154-43b1-90ae-60a4f90a2ee3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:21.134147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5faf81df-e154-43b1-90ae-60a4f90a2ee3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:21.140294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5faf81df-e154-43b1-90ae-60a4f90a2ee3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:21.140737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5faf81df-e154-43b1-90ae-60a4f90a2ee3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:21.141489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5faf81df-e154-43b1-90ae-60a4f90a2ee3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:21.141922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5faf81df-e154-43b1-90ae-60a4f90a2ee3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:21.158364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:21.171301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5faf81df-e154-43b1-90ae-60a4f90a2ee3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041692 Jun 17 13:01:21.171809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 733/1513] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:21.176313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:21.176909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:21.182458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:21.182931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:21.183706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:21.184106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:21.256501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:21.264250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8781861c-2ee2-4a36-8e14-99524db3b846 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091455 Jun 17 13:01:21.264784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 734/1514] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:21 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:22.102468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:22.103140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:22.110174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.110586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.111408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.111840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.244774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:22.253111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ff8453e3-d87d-4bf4-b262-454c1fae3e25 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.154615 Jun 17 13:01:22.253901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 735/1515] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:22.258440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b46779ca-5f1e-4c37-9818-ce0c4c37fb27 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:22.259353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b46779ca-5f1e-4c37-9818-ce0c4c37fb27 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:22.265350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b46779ca-5f1e-4c37-9818-ce0c4c37fb27 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.265797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b46779ca-5f1e-4c37-9818-ce0c4c37fb27 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.266565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b46779ca-5f1e-4c37-9818-ce0c4c37fb27 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.266997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b46779ca-5f1e-4c37-9818-ce0c4c37fb27 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.297242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b46779ca-5f1e-4c37-9818-ce0c4c37fb27 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Jun 17 13:01:22.297858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 736/1516] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:22.302398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6612a653-bda8-49cc-b7e6-9970c1fa6243 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:22.303217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6612a653-bda8-49cc-b7e6-9970c1fa6243 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:22.309237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6612a653-bda8-49cc-b7e6-9970c1fa6243 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.309693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6612a653-bda8-49cc-b7e6-9970c1fa6243 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.310452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6612a653-bda8-49cc-b7e6-9970c1fa6243 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.310892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6612a653-bda8-49cc-b7e6-9970c1fa6243 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.347675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6612a653-bda8-49cc-b7e6-9970c1fa6243 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048442 Jun 17 13:01:22.348518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 737/1517] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:22.352905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:22.353505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:22.359622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.360068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.360825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:22.361258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:22.429099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:22.436898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-03ca42a9-ff45-4892-94a5-0cd2326448a2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087439 Jun 17 13:01:22.437458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 738/1518] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:22 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:23.270875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:23.271496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:23.278650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.279093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.279907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.280339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.429269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:23.441256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-713fd5ca-9cc5-40ca-b7cd-db977de7b269 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.174314 Jun 17 13:01:23.442280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 739/1519] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:23.446900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-675b7101-c36c-4c08-9e67-93a0e146e05e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:23.447854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-675b7101-c36c-4c08-9e67-93a0e146e05e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:23.454784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-675b7101-c36c-4c08-9e67-93a0e146e05e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.455636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-675b7101-c36c-4c08-9e67-93a0e146e05e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.456812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-675b7101-c36c-4c08-9e67-93a0e146e05e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.457291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-675b7101-c36c-4c08-9e67-93a0e146e05e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.486805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-675b7101-c36c-4c08-9e67-93a0e146e05e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Jun 17 13:01:23.491078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 740/1520] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:23.492428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-38d70508-c0a8-4b42-bcf9-abdbbc1491db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:23.493327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-38d70508-c0a8-4b42-bcf9-abdbbc1491db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:23.499166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38d70508-c0a8-4b42-bcf9-abdbbc1491db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.499637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38d70508-c0a8-4b42-bcf9-abdbbc1491db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.500389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38d70508-c0a8-4b42-bcf9-abdbbc1491db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.500817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38d70508-c0a8-4b42-bcf9-abdbbc1491db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.530151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-38d70508-c0a8-4b42-bcf9-abdbbc1491db tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041332 Jun 17 13:01:23.530695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 741/1521] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:23.535067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:23.535659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:23.541406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.541842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.542588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:23.543025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:23.606237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:23.617838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4aa1618a-bffd-4113-a92d-b274c6e926ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085896 Jun 17 13:01:23.618562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 742/1522] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:23 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:24.459993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:24.460690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:24.467020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.467502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.468258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.468691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.609018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:24.620773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e375f515-d54b-4146-a5eb-4827808adf09 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164687 Jun 17 13:01:24.621656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 743/1523] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:24.629027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5f947e3a-6351-4dc2-9ea7-ffa781d4abe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:24.630310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5f947e3a-6351-4dc2-9ea7-ffa781d4abe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:24.636806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f947e3a-6351-4dc2-9ea7-ffa781d4abe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.637259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f947e3a-6351-4dc2-9ea7-ffa781d4abe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.638014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f947e3a-6351-4dc2-9ea7-ffa781d4abe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.638447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f947e3a-6351-4dc2-9ea7-ffa781d4abe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.670543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5f947e3a-6351-4dc2-9ea7-ffa781d4abe6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047539 Jun 17 13:01:24.671203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 744/1524] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:24.677488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d341b2d8-8fd2-4bd4-a4e9-2ffe666debfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:24.679168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d341b2d8-8fd2-4bd4-a4e9-2ffe666debfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:24.685415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d341b2d8-8fd2-4bd4-a4e9-2ffe666debfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.685850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d341b2d8-8fd2-4bd4-a4e9-2ffe666debfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.686596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d341b2d8-8fd2-4bd4-a4e9-2ffe666debfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.687019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d341b2d8-8fd2-4bd4-a4e9-2ffe666debfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.717103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d341b2d8-8fd2-4bd4-a4e9-2ffe666debfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044453 Jun 17 13:01:24.717567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 745/1525] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:24.721917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:24.722478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:24.728705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.729144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.729888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:24.730314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:24.795986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:24.804373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-386f5f29-26f1-46bf-8573-0a4280e7eb83 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085880 Jun 17 13:01:24.804910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 746/1526] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:24 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:25.646857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:25.647644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:25.655325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.655861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.656704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.657186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.804248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:25.815327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dc945cd8-66ad-4624-ac94-ef3031ea3a1a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175322 Jun 17 13:01:25.816013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 747/1527] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:25.821738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a3ef70e6-d751-4738-a6af-212e56dccba9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:25.822654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a3ef70e6-d751-4738-a6af-212e56dccba9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:25.828836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ef70e6-d751-4738-a6af-212e56dccba9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.829282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ef70e6-d751-4738-a6af-212e56dccba9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.830037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ef70e6-d751-4738-a6af-212e56dccba9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.830464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ef70e6-d751-4738-a6af-212e56dccba9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.859633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a3ef70e6-d751-4738-a6af-212e56dccba9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042333 Jun 17 13:01:25.860172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 748/1528] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:25.864712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-319f385f-700f-40ac-b07a-e1e042229ff0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:25.865741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-319f385f-700f-40ac-b07a-e1e042229ff0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:25.871546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-319f385f-700f-40ac-b07a-e1e042229ff0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.871985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-319f385f-700f-40ac-b07a-e1e042229ff0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.872727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-319f385f-700f-40ac-b07a-e1e042229ff0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.873156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-319f385f-700f-40ac-b07a-e1e042229ff0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.903236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-319f385f-700f-40ac-b07a-e1e042229ff0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042018 Jun 17 13:01:25.903727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 749/1529] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:25.908105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:25.908693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:25.911193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:25.914868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.915308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.916090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.916512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.921096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:25.979101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:25.986774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5b375c28-c334-4865-b807-a2cde9306c62 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082138 Jun 17 13:01:25.987334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 750/1530] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:25 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:26.837470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:26.838540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:26.849352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:26.850051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:26.851532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:26.851958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:26.986588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:26.994960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30237ca5-1b66-4670-86a5-f366d37472e9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163870 Jun 17 13:01:26.995562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 751/1531] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:27.000323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a954196-b525-4bd2-bdce-2f585ab0dd62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:27.001228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0a954196-b525-4bd2-bdce-2f585ab0dd62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:27.007883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a954196-b525-4bd2-bdce-2f585ab0dd62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.008397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a954196-b525-4bd2-bdce-2f585ab0dd62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:27.009164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a954196-b525-4bd2-bdce-2f585ab0dd62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.009603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a954196-b525-4bd2-bdce-2f585ab0dd62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:27.040431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0a954196-b525-4bd2-bdce-2f585ab0dd62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Jun 17 13:01:27.040986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 752/1532] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:27.045634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4e396f98-4838-4229-b71d-ac901e46268e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:27.046522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4e396f98-4838-4229-b71d-ac901e46268e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:27.052556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e396f98-4838-4229-b71d-ac901e46268e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.053003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e396f98-4838-4229-b71d-ac901e46268e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:27.053959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e396f98-4838-4229-b71d-ac901e46268e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.054423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e396f98-4838-4229-b71d-ac901e46268e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:27.084497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4e396f98-4838-4229-b71d-ac901e46268e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042485 Jun 17 13:01:27.085130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 753/1533] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:27.089951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:27.090565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:27.097341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.097790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:27.098556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.098992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:27.164683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:27.172753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-680eb200-9844-4f8a-b83f-9895f438192e tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086579 Jun 17 13:01:27.173541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 754/1534] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:27 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:28.016738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:28.017903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:28.026963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.027406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.028184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.028612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.162215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:28.170861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-453d5540-2e55-4c0f-8e16-ffeca0b570b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.160626 Jun 17 13:01:28.171429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 755/1535] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:28.176043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0149deac-9aab-4ff5-9eb4-e0cf65defb19 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:28.176913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0149deac-9aab-4ff5-9eb4-e0cf65defb19 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:28.183306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0149deac-9aab-4ff5-9eb4-e0cf65defb19 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.183782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0149deac-9aab-4ff5-9eb4-e0cf65defb19 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.184563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0149deac-9aab-4ff5-9eb4-e0cf65defb19 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.184991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0149deac-9aab-4ff5-9eb4-e0cf65defb19 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.214718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0149deac-9aab-4ff5-9eb4-e0cf65defb19 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 Jun 17 13:01:28.215262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 756/1536] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:28.219818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7056b155-0a55-4198-8e0f-eec48a946564 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:28.220684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7056b155-0a55-4198-8e0f-eec48a946564 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:28.226888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7056b155-0a55-4198-8e0f-eec48a946564 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.227316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7056b155-0a55-4198-8e0f-eec48a946564 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.228081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7056b155-0a55-4198-8e0f-eec48a946564 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.228504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7056b155-0a55-4198-8e0f-eec48a946564 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.257359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7056b155-0a55-4198-8e0f-eec48a946564 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040878 Jun 17 13:01:28.257891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 757/1537] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:28.262257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:28.262844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:28.268806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.269176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.269904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:28.270325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.335954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:28.344096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11ab1b60-707b-406d-9b8f-6e468fe63048 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085304 Jun 17 13:01:28.344663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 758/1538] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:28 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:29.192684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:29.193637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:29.205217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.205956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.207293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.208056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.342323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:29.350045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-22949a13-571c-4c30-99b6-9fdedba782cd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164138 Jun 17 13:01:29.350610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 759/1539] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:29.355117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-15bf2d79-8dc1-4ecf-a9c6-69d2a48a113a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:29.356058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-15bf2d79-8dc1-4ecf-a9c6-69d2a48a113a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:29.361999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15bf2d79-8dc1-4ecf-a9c6-69d2a48a113a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.362443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15bf2d79-8dc1-4ecf-a9c6-69d2a48a113a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.363198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15bf2d79-8dc1-4ecf-a9c6-69d2a48a113a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.363648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15bf2d79-8dc1-4ecf-a9c6-69d2a48a113a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.401611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-15bf2d79-8dc1-4ecf-a9c6-69d2a48a113a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049833 Jun 17 13:01:29.402075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 760/1540] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:29.406563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3cd91202-86d4-4c0b-9243-ea85cf4420fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:29.407569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3cd91202-86d4-4c0b-9243-ea85cf4420fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:29.413317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd91202-86d4-4c0b-9243-ea85cf4420fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.413801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd91202-86d4-4c0b-9243-ea85cf4420fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.414842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd91202-86d4-4c0b-9243-ea85cf4420fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.415279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cd91202-86d4-4c0b-9243-ea85cf4420fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.444372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3cd91202-86d4-4c0b-9243-ea85cf4420fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041124 Jun 17 13:01:29.444756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 761/1541] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:29.449502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:29.450084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:29.455774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.456208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.456977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.457395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.519506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:29.531435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7cc03510-d656-4ca2-94c2-ad1dff9bf5cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085166 Jun 17 13:01:29.531994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 762/1542] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:29 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:30.371267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:30.372320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:30.384245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.384692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.385468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.385904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.532961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:30.540781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3dbd8750-3b88-47c6-a032-4e87b1f868fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.176484 Jun 17 13:01:30.541335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 763/1543] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:30 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:30.545893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-880709b1-6107-4ba6-95e7-566161720d1d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:30.546812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-880709b1-6107-4ba6-95e7-566161720d1d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:30.552978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-880709b1-6107-4ba6-95e7-566161720d1d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.553397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-880709b1-6107-4ba6-95e7-566161720d1d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.554155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-880709b1-6107-4ba6-95e7-566161720d1d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.554587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-880709b1-6107-4ba6-95e7-566161720d1d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.583881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-880709b1-6107-4ba6-95e7-566161720d1d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041531 Jun 17 13:01:30.584447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 764/1544] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:30.589179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-72768aed-c352-4479-9eb7-505dba622c88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:30.590066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-72768aed-c352-4479-9eb7-505dba622c88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:30.596089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72768aed-c352-4479-9eb7-505dba622c88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.596531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72768aed-c352-4479-9eb7-505dba622c88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.597273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72768aed-c352-4479-9eb7-505dba622c88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.597709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72768aed-c352-4479-9eb7-505dba622c88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.626423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-72768aed-c352-4479-9eb7-505dba622c88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040899 Jun 17 13:01:30.626882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 765/1545] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:30.631440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:30.632054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:30.638212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.638647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.639405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.639849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.703860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:30.707302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:30.712091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7db994a1-2607-4cfd-82ce-1106a27494d1 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083899 Jun 17 13:01:30.712658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 766/1546] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:30 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:31.562235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:31.563326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:31.574426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.575157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.576359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.576976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.717705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:31.725513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-96f87581-f9f2-46ea-9446-40eaa1490e90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170375 Jun 17 13:01:31.726048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 767/1547] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:31.730778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-16323568-1097-441f-8baf-57b62ea67467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:31.731713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-16323568-1097-441f-8baf-57b62ea67467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:31.737473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16323568-1097-441f-8baf-57b62ea67467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.737922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16323568-1097-441f-8baf-57b62ea67467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.738671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16323568-1097-441f-8baf-57b62ea67467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.739115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16323568-1097-441f-8baf-57b62ea67467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.768798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-16323568-1097-441f-8baf-57b62ea67467 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041515 Jun 17 13:01:31.769337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 768/1548] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:31.773951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-48204017-7519-4575-8c19-80316d557ba3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:31.774817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-48204017-7519-4575-8c19-80316d557ba3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:31.780498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48204017-7519-4575-8c19-80316d557ba3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.780936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48204017-7519-4575-8c19-80316d557ba3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.781679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48204017-7519-4575-8c19-80316d557ba3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.782104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48204017-7519-4575-8c19-80316d557ba3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.812373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-48204017-7519-4575-8c19-80316d557ba3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042030 Jun 17 13:01:31.812842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 769/1549] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:31.817040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:31.817627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:31.823844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.824286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.825029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:31.825459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:31.899492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:31.907639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3a255fdd-8660-4352-8914-e70b2dc98de2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.093815 Jun 17 13:01:31.908191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 770/1550] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:31 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:32.747305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:32.748466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:32.759775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.760212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.760967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.761403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.894982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:32.903528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-305cfe72-e1ae-4e8b-a103-4cdfa999f468 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163327 Jun 17 13:01:32.904092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 771/1551] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:32.908531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7fdd7d87-8ecc-4050-9461-179ef3e123f5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:32.909435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7fdd7d87-8ecc-4050-9461-179ef3e123f5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:32.916259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fdd7d87-8ecc-4050-9461-179ef3e123f5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.916698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fdd7d87-8ecc-4050-9461-179ef3e123f5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.917447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fdd7d87-8ecc-4050-9461-179ef3e123f5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.917869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fdd7d87-8ecc-4050-9461-179ef3e123f5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.950058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7fdd7d87-8ecc-4050-9461-179ef3e123f5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044915 Jun 17 13:01:32.950594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 772/1552] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:32.955038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a3974d24-fa22-42a6-94d0-882eff55938e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:32.955957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a3974d24-fa22-42a6-94d0-882eff55938e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:32.962456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3974d24-fa22-42a6-94d0-882eff55938e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.962890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3974d24-fa22-42a6-94d0-882eff55938e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.963664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3974d24-fa22-42a6-94d0-882eff55938e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.964084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3974d24-fa22-42a6-94d0-882eff55938e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.993358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a3974d24-fa22-42a6-94d0-882eff55938e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041150 Jun 17 13:01:32.994119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 773/1553] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:32.998208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:32.998727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:33.004781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:33.005207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:33.005941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:33.006327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:33.073424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:33.081297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8569d663-37dd-4336-a557-fc9e3a26742b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086493 Jun 17 13:01:33.081858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 774/1554] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:32 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:33.925024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:33.926105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:33.935030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:33.935502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:33.936268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:33.936702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.081443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:34.093787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a41fa5a-8237-4c08-b75b-523a5c5b821b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175093 Jun 17 13:01:34.094966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 775/1555] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:34.099552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2845cb06-2e6e-4316-a1a5-9fd9b807bdfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:34.100461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2845cb06-2e6e-4316-a1a5-9fd9b807bdfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:34.106641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2845cb06-2e6e-4316-a1a5-9fd9b807bdfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.107057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2845cb06-2e6e-4316-a1a5-9fd9b807bdfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.107859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2845cb06-2e6e-4316-a1a5-9fd9b807bdfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.108289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2845cb06-2e6e-4316-a1a5-9fd9b807bdfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.138476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2845cb06-2e6e-4316-a1a5-9fd9b807bdfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042463 Jun 17 13:01:34.139047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 776/1556] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:34.143788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f0da189-9fb8-4492-ab49-31b2cb0ad9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:34.144681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f0da189-9fb8-4492-ab49-31b2cb0ad9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:34.150500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0da189-9fb8-4492-ab49-31b2cb0ad9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.150943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0da189-9fb8-4492-ab49-31b2cb0ad9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.151737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0da189-9fb8-4492-ab49-31b2cb0ad9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.152167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0da189-9fb8-4492-ab49-31b2cb0ad9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.181043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f0da189-9fb8-4492-ab49-31b2cb0ad9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040907 Jun 17 13:01:34.181512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 777/1557] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:34.185883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:34.186487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:34.192440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.192887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.193645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.194072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.256799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:34.265619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-89cf09d2-0114-4a96-afa1-4488a32841e2 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083147 Jun 17 13:01:34.266188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 778/1558] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:34 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:35.115878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:35.117095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:35.128938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.129682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.130935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.131704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.268018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:35.276291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d1f38daa-62e0-4cbe-808d-f2ee5e6a2e37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166942 Jun 17 13:01:35.277084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 779/1559] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:35.281779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5417c864-fcf3-4176-905c-e695cf8f0c2f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:35.282698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5417c864-fcf3-4176-905c-e695cf8f0c2f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:35.288713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5417c864-fcf3-4176-905c-e695cf8f0c2f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.289164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5417c864-fcf3-4176-905c-e695cf8f0c2f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5417c864-fcf3-4176-905c-e695cf8f0c2f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.290335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5417c864-fcf3-4176-905c-e695cf8f0c2f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.319892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5417c864-fcf3-4176-905c-e695cf8f0c2f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 Jun 17 13:01:35.320475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 780/1560] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:35.325202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d474bb78-65dd-4a8d-a484-25a93a113bf3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:35.326075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d474bb78-65dd-4a8d-a484-25a93a113bf3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:35.331871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d474bb78-65dd-4a8d-a484-25a93a113bf3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.332304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d474bb78-65dd-4a8d-a484-25a93a113bf3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.333020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d474bb78-65dd-4a8d-a484-25a93a113bf3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.333460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d474bb78-65dd-4a8d-a484-25a93a113bf3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.362202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d474bb78-65dd-4a8d-a484-25a93a113bf3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040686 Jun 17 13:01:35.362739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 781/1561] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:35.367176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:35.367836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:35.373601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.374039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.375459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.375894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.440577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:35.448642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4a7fa8f5-5769-482c-8b79-d50c923d98f4 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084986 Jun 17 13:01:35.449197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 782/1562] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:35 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:36.297878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:36.298908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:36.310145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.310881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.312178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.312884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.335249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:36.455484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:36.463255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2ff76b3-274b-4415-96dd-e469350af354 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172036 Jun 17 13:01:36.463966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 783/1563] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:36.468486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c6dd1af-4a84-448d-a70d-348e653953d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:36.469371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c6dd1af-4a84-448d-a70d-348e653953d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:36.475536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c6dd1af-4a84-448d-a70d-348e653953d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.475987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c6dd1af-4a84-448d-a70d-348e653953d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.476770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c6dd1af-4a84-448d-a70d-348e653953d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.477203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c6dd1af-4a84-448d-a70d-348e653953d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.506725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c6dd1af-4a84-448d-a70d-348e653953d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Jun 17 13:01:36.507260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 784/1564] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:36.511981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-10d1c914-d724-4622-ad67-f7f7e0cb69b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:36.512864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-10d1c914-d724-4622-ad67-f7f7e0cb69b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:36.518648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d1c914-d724-4622-ad67-f7f7e0cb69b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.519086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d1c914-d724-4622-ad67-f7f7e0cb69b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.519864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d1c914-d724-4622-ad67-f7f7e0cb69b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.520294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d1c914-d724-4622-ad67-f7f7e0cb69b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.548822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-10d1c914-d724-4622-ad67-f7f7e0cb69b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040524 Jun 17 13:01:36.549369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 785/1565] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:36.553845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:36.554436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:36.560211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.560650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.561397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.561824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.632649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:36.640876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-db634566-278d-4b2c-bd3c-e9929afc7a43 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.090564 Jun 17 13:01:36.641444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 786/1566] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:36 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:37.484909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:37.485939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:37.496633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.497076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.497826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.498248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.637687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:37.649477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d651391b-ab69-4c4b-9086-213fb6b66fdc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.171741 Jun 17 13:01:37.650380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 787/1567] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:37.655313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-66b1f78f-26eb-42db-b012-b7d8977ec514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:37.656290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-66b1f78f-26eb-42db-b012-b7d8977ec514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:37.662127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66b1f78f-26eb-42db-b012-b7d8977ec514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.662576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66b1f78f-26eb-42db-b012-b7d8977ec514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.663452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66b1f78f-26eb-42db-b012-b7d8977ec514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.663832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66b1f78f-26eb-42db-b012-b7d8977ec514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.693072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-66b1f78f-26eb-42db-b012-b7d8977ec514 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041355 Jun 17 13:01:37.693616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 788/1568] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:37.698188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dce9f843-49f9-4711-b19a-9383011520ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:37.699074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dce9f843-49f9-4711-b19a-9383011520ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:37.704861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dce9f843-49f9-4711-b19a-9383011520ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.705311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dce9f843-49f9-4711-b19a-9383011520ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.706069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dce9f843-49f9-4711-b19a-9383011520ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.706497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dce9f843-49f9-4711-b19a-9383011520ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.735339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dce9f843-49f9-4711-b19a-9383011520ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040645 Jun 17 13:01:37.735848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 789/1569] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:37.740055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:37.740648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:37.746363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.746805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.747601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.748031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.808855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:37.816545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7308af5d-313f-4b95-8a18-bd2615fb0491 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.079785 Jun 17 13:01:37.817108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 790/1570] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:37 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:38.671655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:38.672753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:38.683790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.684534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.685934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.686704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.830425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:38.840611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3c4575a9-e1bc-4f78-8be9-34f324cf464b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.175811 Jun 17 13:01:38.841213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 791/1571] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:38.845723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8408af93-e212-4864-8402-00390db12347 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:38.846644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8408af93-e212-4864-8402-00390db12347 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:38.852425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8408af93-e212-4864-8402-00390db12347 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.852872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8408af93-e212-4864-8402-00390db12347 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.853664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8408af93-e212-4864-8402-00390db12347 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.854100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8408af93-e212-4864-8402-00390db12347 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.884018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8408af93-e212-4864-8402-00390db12347 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041768 Jun 17 13:01:38.884579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 792/1572] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:38.889143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bf1f276e-7b10-48d3-b836-f5bda149e814 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:38.890026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bf1f276e-7b10-48d3-b836-f5bda149e814 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:38.896013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf1f276e-7b10-48d3-b836-f5bda149e814 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.896457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf1f276e-7b10-48d3-b836-f5bda149e814 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.897212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf1f276e-7b10-48d3-b836-f5bda149e814 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.897644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf1f276e-7b10-48d3-b836-f5bda149e814 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.926536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bf1f276e-7b10-48d3-b836-f5bda149e814 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040852 Jun 17 13:01:38.927032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 793/1573] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:38.931250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:38.932197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:38.938144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.938596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.939345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.939818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:39.012296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:39.020488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2073e33-36dc-4254-97eb-bbcfe309497f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.092513 Jun 17 13:01:39.021051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 794/1574] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:38 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:39.861957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:39.863063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:39.872621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.873061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:39.873907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.874336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.020755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:40.031488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9bb4cfff-47df-424b-bc75-022775c236ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.176029 Jun 17 13:01:40.032049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 795/1575] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:40.105026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c273c673-dba2-49db-a83c-53d6dbc0c875 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:40.106063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c273c673-dba2-49db-a83c-53d6dbc0c875 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:40.112450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c273c673-dba2-49db-a83c-53d6dbc0c875 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.112826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c273c673-dba2-49db-a83c-53d6dbc0c875 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.113580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c273c673-dba2-49db-a83c-53d6dbc0c875 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.114002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c273c673-dba2-49db-a83c-53d6dbc0c875 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.144111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c273c673-dba2-49db-a83c-53d6dbc0c875 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110974 Jun 17 13:01:40.144658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 796/1576] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:40.149122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bfb8c332-8b21-40b1-8195-79448bd04321 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:40.150005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bfb8c332-8b21-40b1-8195-79448bd04321 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:40.156248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfb8c332-8b21-40b1-8195-79448bd04321 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.156729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfb8c332-8b21-40b1-8195-79448bd04321 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.157483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfb8c332-8b21-40b1-8195-79448bd04321 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.157916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfb8c332-8b21-40b1-8195-79448bd04321 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.186852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bfb8c332-8b21-40b1-8195-79448bd04321 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041217 Jun 17 13:01:40.187401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 797/1577] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:40.191651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:40.192248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:40.198015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.198447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.199215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.199683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.260035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:40.267836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6311bbee-2575-468e-bd55-02e96b1f5432 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.079459 Jun 17 13:01:40.268396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 798/1578] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:40 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:40.307552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:01:40.308082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:01:41.055013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:41.055665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:41.064788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.065508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.066795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.067560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.211897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:41.219816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-971399c1-c6b0-46b2-8f61-4731d83b19e2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.171408 Jun 17 13:01:41.220392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 799/1579] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:41.224998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8bf1c5cd-4b65-4ef4-8b82-a2232f3f5ed4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:41.225920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8bf1c5cd-4b65-4ef4-8b82-a2232f3f5ed4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:41.228686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:41.232291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf1c5cd-4b65-4ef4-8b82-a2232f3f5ed4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.232733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf1c5cd-4b65-4ef4-8b82-a2232f3f5ed4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.233495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf1c5cd-4b65-4ef4-8b82-a2232f3f5ed4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.233925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf1c5cd-4b65-4ef4-8b82-a2232f3f5ed4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.238188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:41.264311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8bf1c5cd-4b65-4ef4-8b82-a2232f3f5ed4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Jun 17 13:01:41.264842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 800/1580] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:41.269329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-decec794-bb9e-4230-9420-51008004a80a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:41.270224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-decec794-bb9e-4230-9420-51008004a80a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:41.275966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-decec794-bb9e-4230-9420-51008004a80a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.276410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-decec794-bb9e-4230-9420-51008004a80a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.277172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-decec794-bb9e-4230-9420-51008004a80a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.277608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-decec794-bb9e-4230-9420-51008004a80a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.306374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-decec794-bb9e-4230-9420-51008004a80a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040500 Jun 17 13:01:41.306981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 801/1581] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:41.311305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:41.311933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:41.317730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.318175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.318933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.319361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.386446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:41.394649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b4e382df-d778-4ecb-a4ea-491bfeeb2c38 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.086671 Jun 17 13:01:41.395182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 802/1582] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:41 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:42.241149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:42.242244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:42.253303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.254027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.255284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.256065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.389457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:42.401187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e3f45d23-c099-49f8-84af-401da356aff0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166240 Jun 17 13:01:42.402122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 803/1583] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:42.406708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c26f141b-7d90-4688-91fc-d941eb078b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:42.407659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c26f141b-7d90-4688-91fc-d941eb078b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:42.414600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c26f141b-7d90-4688-91fc-d941eb078b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.415281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c26f141b-7d90-4688-91fc-d941eb078b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.416233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c26f141b-7d90-4688-91fc-d941eb078b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.416989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c26f141b-7d90-4688-91fc-d941eb078b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.446112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c26f141b-7d90-4688-91fc-d941eb078b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042894 Jun 17 13:01:42.446676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 804/1584] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:42.451416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-22aa587a-f312-4f2b-a703-9d06b23e6247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:42.452353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-22aa587a-f312-4f2b-a703-9d06b23e6247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:42.458297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22aa587a-f312-4f2b-a703-9d06b23e6247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.458735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22aa587a-f312-4f2b-a703-9d06b23e6247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.459525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22aa587a-f312-4f2b-a703-9d06b23e6247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.459958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22aa587a-f312-4f2b-a703-9d06b23e6247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.489466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-22aa587a-f312-4f2b-a703-9d06b23e6247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041798 Jun 17 13:01:42.490014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 805/1585] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:42.494273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:42.494895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:42.500836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.501280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.502029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.502459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.566640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:42.574561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-06ca3e98-0f05-4c74-b615-e369ea14f5a8 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083612 Jun 17 13:01:42.575118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 806/1586] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:42 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:43.423398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:43.424595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:43.435125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.435606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.436359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.436787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.578153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:43.586184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-438db873-4693-4f98-9ef8-ea78e93b1003 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.170070 Jun 17 13:01:43.586753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 807/1587] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:01:43.591781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9fb77534-0a7b-4b03-bee6-7baf46eeaf7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:43.592699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9fb77534-0a7b-4b03-bee6-7baf46eeaf7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:43.598577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fb77534-0a7b-4b03-bee6-7baf46eeaf7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.599026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fb77534-0a7b-4b03-bee6-7baf46eeaf7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.599823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fb77534-0a7b-4b03-bee6-7baf46eeaf7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.600253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fb77534-0a7b-4b03-bee6-7baf46eeaf7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.629878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9fb77534-0a7b-4b03-bee6-7baf46eeaf7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042150 Jun 17 13:01:43.630468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 808/1588] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:43.704596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-091aec75-69cd-4275-8c06-7af50a44995d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:43.705574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-091aec75-69cd-4275-8c06-7af50a44995d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:43.712146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-091aec75-69cd-4275-8c06-7af50a44995d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.712592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-091aec75-69cd-4275-8c06-7af50a44995d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.713588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-091aec75-69cd-4275-8c06-7af50a44995d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.713866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-091aec75-69cd-4275-8c06-7af50a44995d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.742696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-091aec75-69cd-4275-8c06-7af50a44995d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111216 Jun 17 13:01:43.743233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 809/1589] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:43.747755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:43.748348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:43.754909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.755352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.756142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.756583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.816711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:43.824450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6bcebc89-efc1-4c8b-bcea-10f3a831d7de tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080212 Jun 17 13:01:43.825016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 810/1590] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:43 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:43.986665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:01:43.987020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:01:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:01:44.606297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:44.607044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:44.619023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.619561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.620497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.621003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.772257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:44.779964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-31dde370-ec2a-4e0b-a9c8-647896790e49 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.179472 Jun 17 13:01:44.780517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 811/1591] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:44.785049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98df498f-1c0c-48ce-a69a-dfa77eced282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:44.785994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98df498f-1c0c-48ce-a69a-dfa77eced282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:44.791857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98df498f-1c0c-48ce-a69a-dfa77eced282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.792350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98df498f-1c0c-48ce-a69a-dfa77eced282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.793025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98df498f-1c0c-48ce-a69a-dfa77eced282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.793472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98df498f-1c0c-48ce-a69a-dfa77eced282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.822420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98df498f-1c0c-48ce-a69a-dfa77eced282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Jun 17 13:01:44.823150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 812/1592] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:44.827633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-26fa9836-8db0-4890-95ed-83382a0f7be2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:44.828528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-26fa9836-8db0-4890-95ed-83382a0f7be2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:44.834506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26fa9836-8db0-4890-95ed-83382a0f7be2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.834973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26fa9836-8db0-4890-95ed-83382a0f7be2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.835765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26fa9836-8db0-4890-95ed-83382a0f7be2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.836199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26fa9836-8db0-4890-95ed-83382a0f7be2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.865142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-26fa9836-8db0-4890-95ed-83382a0f7be2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040943 Jun 17 13:01:44.865608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 813/1593] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:44.870309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:44.870674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:44.876410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.876854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.877608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.878041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.944004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:44.951941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c8053e0e-ecdd-48ed-8216-10f44f1a5c6f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.085412 Jun 17 13:01:44.952494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 814/1594] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:44 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:45.800899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:45.802016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:45.811036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.811495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:45.812245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.812670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:45.947162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:45.959289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c4bff9a3-37e8-48d4-9f60-98853904fc13 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164664 Jun 17 13:01:45.960155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 815/1595] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:45.965325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-04e8b870-1919-4d2f-8956-a7e35c2acd78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:45.966232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-04e8b870-1919-4d2f-8956-a7e35c2acd78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:45.972375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04e8b870-1919-4d2f-8956-a7e35c2acd78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.972817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04e8b870-1919-4d2f-8956-a7e35c2acd78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:45.973653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04e8b870-1919-4d2f-8956-a7e35c2acd78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.974086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04e8b870-1919-4d2f-8956-a7e35c2acd78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:45.999931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:46.005165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-04e8b870-1919-4d2f-8956-a7e35c2acd78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Jun 17 13:01:46.006152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 816/1596] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:46.011121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4de6bb46-3341-4961-8356-f5ca3d3820ab tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:46.012058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4de6bb46-3341-4961-8356-f5ca3d3820ab tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:46.017982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4de6bb46-3341-4961-8356-f5ca3d3820ab tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.018419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4de6bb46-3341-4961-8356-f5ca3d3820ab tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.019204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4de6bb46-3341-4961-8356-f5ca3d3820ab tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.019668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4de6bb46-3341-4961-8356-f5ca3d3820ab tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.048648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4de6bb46-3341-4961-8356-f5ca3d3820ab tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041449 Jun 17 13:01:46.049197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 817/1597] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:46.053534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:46.054062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:46.059868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.060315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.061071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.061501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.131167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:46.139497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-203a99c5-eced-4cc8-b468-a6ea2c660938 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089331 Jun 17 13:01:46.140042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 818/1598] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:46 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:46.979678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:46.980394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:46.987604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.988052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.988815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.989246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.172557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:47.183143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49d012c6-a6f4-4247-9647-68baacfc89e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.208390 Jun 17 13:01:47.183732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 819/1599] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:47.188198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d6f58920-20dd-4bcf-b74f-95082d9a4f61 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:47.189106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d6f58920-20dd-4bcf-b74f-95082d9a4f61 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:47.195115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6f58920-20dd-4bcf-b74f-95082d9a4f61 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.195601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6f58920-20dd-4bcf-b74f-95082d9a4f61 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.196363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6f58920-20dd-4bcf-b74f-95082d9a4f61 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.196816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6f58920-20dd-4bcf-b74f-95082d9a4f61 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.226533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d6f58920-20dd-4bcf-b74f-95082d9a4f61 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 Jun 17 13:01:47.227120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 820/1600] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:47.232144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5b883238-dbb1-42d9-934c-3df34bd5f478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:47.232956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5b883238-dbb1-42d9-934c-3df34bd5f478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:47.238880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b883238-dbb1-42d9-934c-3df34bd5f478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.239320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b883238-dbb1-42d9-934c-3df34bd5f478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.240103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b883238-dbb1-42d9-934c-3df34bd5f478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.240527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b883238-dbb1-42d9-934c-3df34bd5f478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.280945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5b883238-dbb1-42d9-934c-3df34bd5f478 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052661 Jun 17 13:01:47.281494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 821/1601] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:47.285913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:47.286508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:47.293482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.294052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.295123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.295737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.361467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:47.372167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8d7fd90d-f911-4843-a671-63c506aaffcf tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.089728 Jun 17 13:01:47.372700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 822/1602] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:47 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:48.202789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:48.203601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:48.212409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.213001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.213970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.214516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.353034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:48.361332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0cfbb4c3-6424-48d0-812c-4f9d49b33386 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.163459 Jun 17 13:01:48.361901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 823/1603] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:48.366389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9693d3ab-72d7-46e6-b6d3-6b1a8ba80d79 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:48.367302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9693d3ab-72d7-46e6-b6d3-6b1a8ba80d79 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:48.373639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9693d3ab-72d7-46e6-b6d3-6b1a8ba80d79 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.374024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9693d3ab-72d7-46e6-b6d3-6b1a8ba80d79 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.374787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9693d3ab-72d7-46e6-b6d3-6b1a8ba80d79 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.375219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9693d3ab-72d7-46e6-b6d3-6b1a8ba80d79 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.406047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9693d3ab-72d7-46e6-b6d3-6b1a8ba80d79 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043120 Jun 17 13:01:48.406611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 824/1604] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:48.411123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-440aa0c3-244c-472b-b3e8-f78d6a5f994d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:48.412042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-440aa0c3-244c-472b-b3e8-f78d6a5f994d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:48.418064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-440aa0c3-244c-472b-b3e8-f78d6a5f994d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.418508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-440aa0c3-244c-472b-b3e8-f78d6a5f994d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.419257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-440aa0c3-244c-472b-b3e8-f78d6a5f994d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.419725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-440aa0c3-244c-472b-b3e8-f78d6a5f994d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.448237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-440aa0c3-244c-472b-b3e8-f78d6a5f994d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040647 Jun 17 13:01:48.448800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 825/1605] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:48.453027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:48.453616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:48.459255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.459727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.460478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.460907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.521856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:48.530264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aa4ec06a-8765-46de-b1c9-73f3b1cff65f tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080544 Jun 17 13:01:48.530826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 826/1606] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:48 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:49.383930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:49.384902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:49.396136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.396936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.398197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.398939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.534535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:49.542825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a6807d99-2ad5-4308-9d8b-1590512bcc28 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.165925 Jun 17 13:01:49.543395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 827/1607] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:49.548125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e8ea6da8-17ea-4ed0-8f0c-394dee4402a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:49.549041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e8ea6da8-17ea-4ed0-8f0c-394dee4402a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:49.554845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8ea6da8-17ea-4ed0-8f0c-394dee4402a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.555288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8ea6da8-17ea-4ed0-8f0c-394dee4402a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.556171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8ea6da8-17ea-4ed0-8f0c-394dee4402a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.556597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8ea6da8-17ea-4ed0-8f0c-394dee4402a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.585985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e8ea6da8-17ea-4ed0-8f0c-394dee4402a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Jun 17 13:01:49.586536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 828/1608] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:49.591122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9660c1da-9288-4c7e-9e93-8b11cbda6066 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:49.592020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9660c1da-9288-4c7e-9e93-8b11cbda6066 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:49.597883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9660c1da-9288-4c7e-9e93-8b11cbda6066 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.598317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9660c1da-9288-4c7e-9e93-8b11cbda6066 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.599050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9660c1da-9288-4c7e-9e93-8b11cbda6066 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.599579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9660c1da-9288-4c7e-9e93-8b11cbda6066 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.628544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9660c1da-9288-4c7e-9e93-8b11cbda6066 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040967 Jun 17 13:01:49.629084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 829/1609] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:49.633467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:49.634151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:49.639915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.640349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.641092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.641512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.713571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:49.725728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e0ded33b-03c1-47cd-850f-6d736f299932 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.095511 Jun 17 13:01:49.726561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 830/1610] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:49 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:50.560459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:50.561165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:50.568101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.568553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.569315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.569751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.718138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:50.729438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-29edfd0c-cd75-4a63-ae62-545243c51546 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173022 Jun 17 13:01:50.730025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 831/1611] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:50.734554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d61b65f2-f816-46c5-9f6e-88e6e305fae5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:50.735476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d61b65f2-f816-46c5-9f6e-88e6e305fae5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:50.741329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d61b65f2-f816-46c5-9f6e-88e6e305fae5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.741779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d61b65f2-f816-46c5-9f6e-88e6e305fae5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.742567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d61b65f2-f816-46c5-9f6e-88e6e305fae5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.743015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d61b65f2-f816-46c5-9f6e-88e6e305fae5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.772209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d61b65f2-f816-46c5-9f6e-88e6e305fae5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041196 Jun 17 13:01:50.772767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 832/1612] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:50.777270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f16c7c3-7c73-4476-9523-c6176f2cbd20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:50.778151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f16c7c3-7c73-4476-9523-c6176f2cbd20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:50.783926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f16c7c3-7c73-4476-9523-c6176f2cbd20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.784367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f16c7c3-7c73-4476-9523-c6176f2cbd20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.785118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f16c7c3-7c73-4476-9523-c6176f2cbd20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.785552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f16c7c3-7c73-4476-9523-c6176f2cbd20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.801747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:50.815145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f16c7c3-7c73-4476-9523-c6176f2cbd20 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041317 Jun 17 13:01:50.815651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 833/1613] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:50.819889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:50.820483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:50.826258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.826711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.827501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.827940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.888960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:50.896861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f29e311b-deb6-4c61-8f6a-ebe18e39e0b3 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.080325 Jun 17 13:01:50.897455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 834/1614] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:51.751717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:51.752801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:51.764272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.764997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.766248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.766944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.903886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:51.911657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-850af66a-f928-466e-b664-f38916aaacf2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.166855 Jun 17 13:01:51.912206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 835/1615] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:01:51.916966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a89f571f-0d1c-4887-8902-15be42ade4b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:51.917908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a89f571f-0d1c-4887-8902-15be42ade4b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:51.923840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89f571f-0d1c-4887-8902-15be42ade4b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.924290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89f571f-0d1c-4887-8902-15be42ade4b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.925087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89f571f-0d1c-4887-8902-15be42ade4b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.925520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a89f571f-0d1c-4887-8902-15be42ade4b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.955682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a89f571f-0d1c-4887-8902-15be42ade4b2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 Jun 17 13:01:51.956226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 836/1616] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:51.960856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3308ace2-dd1e-404f-8983-6ce4172a10de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:51.961502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3308ace2-dd1e-404f-8983-6ce4172a10de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:51.967184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3308ace2-dd1e-404f-8983-6ce4172a10de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.967695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3308ace2-dd1e-404f-8983-6ce4172a10de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.968446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3308ace2-dd1e-404f-8983-6ce4172a10de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.968877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3308ace2-dd1e-404f-8983-6ce4172a10de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:52.000353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3308ace2-dd1e-404f-8983-6ce4172a10de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042792 Jun 17 13:01:52.000892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 837/1617] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:52.005231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:52.005758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:52.011981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:52.012427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:52.013186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:52.013622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:52.081878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:52.089747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5f0d11e8-808b-4f61-9c1a-0c7cb89af205 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.087930 Jun 17 13:01:52.090311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 838/1618] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:52.933237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:52.934888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:52.946030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:52.946463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:52.947248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:52.947713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.087735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:53.096051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43d1ce5c-2b0a-4493-ac08-08b6a292c200 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169784 Jun 17 13:01:53.096630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 839/1619] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:53.101389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-383c990d-7e5d-4a4f-9184-a7a01df95c14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:53.102307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-383c990d-7e5d-4a4f-9184-a7a01df95c14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:53.108697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-383c990d-7e5d-4a4f-9184-a7a01df95c14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.109140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-383c990d-7e5d-4a4f-9184-a7a01df95c14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.109899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-383c990d-7e5d-4a4f-9184-a7a01df95c14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.110330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-383c990d-7e5d-4a4f-9184-a7a01df95c14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.140583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-383c990d-7e5d-4a4f-9184-a7a01df95c14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Jun 17 13:01:53.141139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 840/1620] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:53.145768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1d4410b3-57ec-415b-8e88-d2f3d56dee9a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:53.146667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1d4410b3-57ec-415b-8e88-d2f3d56dee9a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:53.152659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d4410b3-57ec-415b-8e88-d2f3d56dee9a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.153098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d4410b3-57ec-415b-8e88-d2f3d56dee9a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.153879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d4410b3-57ec-415b-8e88-d2f3d56dee9a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.154295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d4410b3-57ec-415b-8e88-d2f3d56dee9a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.182975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1d4410b3-57ec-415b-8e88-d2f3d56dee9a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040729 Jun 17 13:01:53.183429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 841/1621] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:53.187828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:53.188421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:53.194282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.194715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.195508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.195932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.261461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:53.269273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e4e3750-20d1-409d-bb74-71aad4613498 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.084862 Jun 17 13:01:53.269829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 842/1622] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:53 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:54.117439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:54.118414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:54.125487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.125931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.126693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.127110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.263243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:54.276090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7286bf5c-c77e-4844-bf0a-029781739a61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.164129 Jun 17 13:01:54.277605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 843/1623] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:54.285278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08226a86-b17e-41e4-9e9b-d02305e01783 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:54.286754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08226a86-b17e-41e4-9e9b-d02305e01783 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:54.294089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08226a86-b17e-41e4-9e9b-d02305e01783 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.294526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08226a86-b17e-41e4-9e9b-d02305e01783 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.295284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08226a86-b17e-41e4-9e9b-d02305e01783 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.295751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08226a86-b17e-41e4-9e9b-d02305e01783 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.324488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08226a86-b17e-41e4-9e9b-d02305e01783 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Jun 17 13:01:54.325045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 844/1624] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:54.329443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c6a16a75-59e7-496e-943e-71abf8402170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:54.330327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c6a16a75-59e7-496e-943e-71abf8402170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:54.336024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6a16a75-59e7-496e-943e-71abf8402170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.336504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6a16a75-59e7-496e-943e-71abf8402170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.337250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6a16a75-59e7-496e-943e-71abf8402170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.337682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6a16a75-59e7-496e-943e-71abf8402170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.366134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c6a16a75-59e7-496e-943e-71abf8402170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040127 Jun 17 13:01:54.366690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 845/1625] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:54.371007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:54.371636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:54.377628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.378073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.378801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.379229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.442156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:54.449971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f408df3-fde8-4e35-890a-84b32425dd9b tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.082370 Jun 17 13:01:54.450531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 846/1626] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:54 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:55.302286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:55.303252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:55.311044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.311520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.312276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.312707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.460038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:55.468560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c9a7f44-9700-47ae-993e-fe31e968def3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.172890 Jun 17 13:01:55.469152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 847/1627] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:55.473782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-02a0b5bc-d8f6-4a4a-a874-9846087b6949 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:55.474697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-02a0b5bc-d8f6-4a4a-a874-9846087b6949 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:55.480977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-02a0b5bc-d8f6-4a4a-a874-9846087b6949 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.481424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-02a0b5bc-d8f6-4a4a-a874-9846087b6949 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.482190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-02a0b5bc-d8f6-4a4a-a874-9846087b6949 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.482622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-02a0b5bc-d8f6-4a4a-a874-9846087b6949 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.513000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-02a0b5bc-d8f6-4a4a-a874-9846087b6949 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042849 Jun 17 13:01:55.513518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 848/1628] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:55.518182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4df29d55-149f-40a3-952d-5ee8d58f3455 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:55.519215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4df29d55-149f-40a3-952d-5ee8d58f3455 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:55.525261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4df29d55-149f-40a3-952d-5ee8d58f3455 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.525706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4df29d55-149f-40a3-952d-5ee8d58f3455 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.526459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4df29d55-149f-40a3-952d-5ee8d58f3455 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.526891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4df29d55-149f-40a3-952d-5ee8d58f3455 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.556505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4df29d55-149f-40a3-952d-5ee8d58f3455 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041926 Jun 17 13:01:55.557028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 849/1629] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:55.561462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:55.562054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:55.564629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:55.568502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.568940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.569700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.570155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.575690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:55.631866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:55.639610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-265b4673-7225-4fcf-a39d-b1de50a82aa5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081626 Jun 17 13:01:55.640188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 850/1630] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:55 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:56.486436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:56.487147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:56.494276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.494857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.495662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.496102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.630481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:56.639806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ad7b24cb-cacd-492c-a1f9-4cf10e98d615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.157246 Jun 17 13:01:56.640391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 851/1631] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:56.645069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-325b2fc5-7581-4226-902a-3e7f15c8aaa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:56.645993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-325b2fc5-7581-4226-902a-3e7f15c8aaa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:56.652320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-325b2fc5-7581-4226-902a-3e7f15c8aaa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.652795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-325b2fc5-7581-4226-902a-3e7f15c8aaa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.653560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-325b2fc5-7581-4226-902a-3e7f15c8aaa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.653996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-325b2fc5-7581-4226-902a-3e7f15c8aaa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.685233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-325b2fc5-7581-4226-902a-3e7f15c8aaa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 Jun 17 13:01:56.685781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 852/1632] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:56.690291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ad0e09c8-82fd-4d8f-8f63-0b5f1bc2fa69 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:56.691168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ad0e09c8-82fd-4d8f-8f63-0b5f1bc2fa69 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:56.697224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad0e09c8-82fd-4d8f-8f63-0b5f1bc2fa69 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.697657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad0e09c8-82fd-4d8f-8f63-0b5f1bc2fa69 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.698404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad0e09c8-82fd-4d8f-8f63-0b5f1bc2fa69 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.698818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad0e09c8-82fd-4d8f-8f63-0b5f1bc2fa69 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.727806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ad0e09c8-82fd-4d8f-8f63-0b5f1bc2fa69 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040714 Jun 17 13:01:56.728610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 853/1633] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:56.732928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:56.733536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:56.741308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.741763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.742737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.743237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.813520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:56.821406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b338047a-a87c-446f-ab18-ba70388fe71a tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.091831 Jun 17 13:01:56.822169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 854/1634] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:56 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:57.661166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:57.662268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:57.670357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.670800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.671603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.672034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.813141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:57.824096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1c6113c9-7672-4476-b38a-fe3908d8ee07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169461 Jun 17 13:01:57.824701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 855/1635] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:57.829239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3e008b34-1044-4657-b1ae-62031973fbb5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:57.830160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3e008b34-1044-4657-b1ae-62031973fbb5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:57.838465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e008b34-1044-4657-b1ae-62031973fbb5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.838941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e008b34-1044-4657-b1ae-62031973fbb5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.839777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e008b34-1044-4657-b1ae-62031973fbb5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.840225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e008b34-1044-4657-b1ae-62031973fbb5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.870044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3e008b34-1044-4657-b1ae-62031973fbb5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Jun 17 13:01:57.870582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 856/1636] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:57.875358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b330a668-6a0b-4c3d-ae2c-57a5cafdb0f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:57.876276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b330a668-6a0b-4c3d-ae2c-57a5cafdb0f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:57.882159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b330a668-6a0b-4c3d-ae2c-57a5cafdb0f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.882596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b330a668-6a0b-4c3d-ae2c-57a5cafdb0f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.883350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b330a668-6a0b-4c3d-ae2c-57a5cafdb0f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.884215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b330a668-6a0b-4c3d-ae2c-57a5cafdb0f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.912074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b330a668-6a0b-4c3d-ae2c-57a5cafdb0f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040527 Jun 17 13:01:57.912589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 857/1637] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:57.917118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:57.917712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:57.923805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.924235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.924995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.925428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.985624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:57.993562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-06d24469-833f-400f-abb5-9ce11ec472bd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.079790 Jun 17 13:01:57.994114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 858/1638] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:57 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:58.843338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:58.844086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:58.852912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:58.853353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:58.854114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:58.854541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.003355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:59.011847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95067731-bac1-41b6-af88-8c5d986b76b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.173863 Jun 17 13:01:59.012414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 859/1639] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:59.016978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2271a05a-d4a9-4ce0-9f36-3e66818dac51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:59.017913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2271a05a-d4a9-4ce0-9f36-3e66818dac51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:59.025114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2271a05a-d4a9-4ce0-9f36-3e66818dac51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.025560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2271a05a-d4a9-4ce0-9f36-3e66818dac51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.026350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2271a05a-d4a9-4ce0-9f36-3e66818dac51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.026780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2271a05a-d4a9-4ce0-9f36-3e66818dac51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.060722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2271a05a-d4a9-4ce0-9f36-3e66818dac51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047184 Jun 17 13:01:59.061318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 860/1640] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:01:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:59.066264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a60a0612-aa11-4504-90af-ee1c5d875742 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:59.067185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a60a0612-aa11-4504-90af-ee1c5d875742 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:59.074157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60a0612-aa11-4504-90af-ee1c5d875742 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.074577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60a0612-aa11-4504-90af-ee1c5d875742 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.075386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60a0612-aa11-4504-90af-ee1c5d875742 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.075823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a60a0612-aa11-4504-90af-ee1c5d875742 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.105240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a60a0612-aa11-4504-90af-ee1c5d875742 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042810 Jun 17 13:01:59.105713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 861/1641] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:01:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:59.109982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:59.110568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:59.116784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.117246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.118294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.118933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.187589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:59.195560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1b08d3e8-7df6-4a7a-9bd9-87d31eca6d45 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.088834 Jun 17 13:01:59.196124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 862/1642] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:59 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:00.076919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-543ab620-a04c-42f3-9542-58a70dd02d15 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.078364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-543ab620-a04c-42f3-9542-58a70dd02d15 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.088867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543ab620-a04c-42f3-9542-58a70dd02d15 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.089576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543ab620-a04c-42f3-9542-58a70dd02d15 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.090872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543ab620-a04c-42f3-9542-58a70dd02d15 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.091640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543ab620-a04c-42f3-9542-58a70dd02d15 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.131338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-543ab620-a04c-42f3-9542-58a70dd02d15 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060990 Jun 17 13:02:00.132028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 863/1643] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:00.139117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.140036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.149514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.149951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.150716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.151145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.311300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.324096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c351fb36-133d-42d1-b9bd-8bf176426b3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.190232 Jun 17 13:02:00.324963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 864/1644] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:00.330516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fb978eb6-189e-442a-84ee-8724dc9c6a14 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.331348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fb978eb6-189e-442a-84ee-8724dc9c6a14 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.338942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb978eb6-189e-442a-84ee-8724dc9c6a14 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.339418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb978eb6-189e-442a-84ee-8724dc9c6a14 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.340205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb978eb6-189e-442a-84ee-8724dc9c6a14 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.340639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb978eb6-189e-442a-84ee-8724dc9c6a14 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.374248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fb978eb6-189e-442a-84ee-8724dc9c6a14 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048108 Jun 17 13:02:00.374840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 865/1645] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:02:00.379386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.380002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.385813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:02:00.386402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:02:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:02:00.387358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.387823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.388594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.389030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.475636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.481126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:00.488358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9671d56b-1c6b-400d-beeb-5fab834b4823 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.112210 Jun 17 13:02:00.489030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 866/1646] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:00.861270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.862069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.871406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.871932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.872991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.873699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:10.866768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=34 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:10.894897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=4 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:11.397633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:02:11.397899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:03:00.830932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:03:01.020237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:03:10.835499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=4 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:11.024803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=4 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:27.248305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:03:27.249165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:03:34.976226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:03:34.977188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:05:00.316655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:05:00.317314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:05:01.158337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [0062dc67-0e30-4e55-89a4-3720ad1fc4ba] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:05:01.182550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:05:01.186080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:05:01.187533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:05:01.188920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:05:01.191460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:05:01.194179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:05:01.196531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) Jun 17 13:05:01.199810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:05:01.201801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15553572-171d-4370-8f6a-57478506c890) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:05:01.201801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-200ed428-e96f-44fe-a96f-59dcb93f335c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 180.423776 Jun 17 13:05:01.201801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 867/1647] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:02:00 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 269 bytes in 180425 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:05:01.201801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a4a4ac55-d683-4b7b-8209-12d3326445c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:01.202474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a4a4ac55-d683-4b7b-8209-12d3326445c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:01.203259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4a4ac55-d683-4b7b-8209-12d3326445c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.203744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4a4ac55-d683-4b7b-8209-12d3326445c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.204521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4a4ac55-d683-4b7b-8209-12d3326445c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.204948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4a4ac55-d683-4b7b-8209-12d3326445c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.234808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a4a4ac55-d683-4b7b-8209-12d3326445c5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Jun 17 13:05:01.235387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 868/1648] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:05:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:05:01.323494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:01.324120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:01.330325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.330767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.331559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.331990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.465317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:01.473239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-25bae472-17a4-4418-a9c1-6e864e3f8148 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.236929 Jun 17 13:05:01.473864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 869/1649] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:01.478639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4b9e55e-a3c8-4115-86b2-ac925aab4772 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:01.479764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4b9e55e-a3c8-4115-86b2-ac925aab4772 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:01.485667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4b9e55e-a3c8-4115-86b2-ac925aab4772 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.486110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4b9e55e-a3c8-4115-86b2-ac925aab4772 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.486899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4b9e55e-a3c8-4115-86b2-ac925aab4772 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.487325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4b9e55e-a3c8-4115-86b2-ac925aab4772 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.517458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4b9e55e-a3c8-4115-86b2-ac925aab4772 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042211 Jun 17 13:05:01.517911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 870/1650] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:05:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:05:01.522241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:01.522831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:01.529035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.529480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.530250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.530675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.592714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:01.600493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0cfde86a-fa57-4d6d-b262-ab77662d4da5 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.081649 Jun 17 13:05:01.601049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 871/1651] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:01 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:01.605715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:01.606201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:01.612006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.612446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.613195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.613617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:02.167329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [0062dc67-0e30-4e55-89a4-3720ad1fc4ba] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 49832. Jun 17 13:05:02.172292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f7a0f3cc-823c-4794-8465-a71c71e4138c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 202 len: 0 microversion: 2.1 time: 241.470403 Jun 17 13:05:02.173154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 781/1652] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:01:00 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 0 bytes in 241472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:05:02.180455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:02.181028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:02.190182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:02.190665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:02.191635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:02.192189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:04.000878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:05:04.001554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:05:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:05:11.609782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=10 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:11.632366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=28 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:12.186784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:12.211429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:31.410923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:05:31.411757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:06:47.261135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:06:47.261834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:06:54.988141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:06:54.988141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:06:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:07:01.710021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:07:01.833092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:07:11.714204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=4 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:07:11.837237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=4 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:08:20.327858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:08:20.328925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:08:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:08:24.010489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:08:24.012446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:08:51.422008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:08:51.422692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:09:02.163472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:09:02.165670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:09:02.167320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:09:02.168024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:09:02.169163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:09:02.170869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:09:02.172633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) Jun 17 13:09:02.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:09:02.176636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b8c41739-9f0f-42c7-8f66-ad1e70e699d2) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:09:02.176636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 240.565139 Jun 17 13:09:02.176636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:09:02.176636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (10.222.0.87) Jun 17 13:09:02.176636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-88d8cc7e-d1d2-4ec8-aaa7-436d02451245 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Unhandled error: OSError: write error Jun 17 13:09:02.176636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:09:02.176636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:09:02.177339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 872/1653] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:05:01 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 0 bytes in 240569 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:09:02.187803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:09:02.188691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:09:02.195808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.196261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.197023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.197456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.227698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055903 Jun 17 13:09:02.228182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:09:02.228182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (10.222.0.87) Jun 17 13:09:02.228762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-774b1ffa-409e-4e57-98ad-11ee4716e461 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Unhandled error: OSError: write error Jun 17 13:09:02.228762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:09:02.228762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:09:02.229021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 873/1654] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:09:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:09:02.233189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:09:02.233790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:09:02.239664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.240106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.240861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.241288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.274864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [0062dc67-0e30-4e55-89a4-3720ad1fc4ba] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:09:02.379300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:09:02.387311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.157493 Jun 17 13:09:02.387853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (ip 10.222.0.87) !!! Jun 17 13:09:02.387853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (10.222.0.87) Jun 17 13:09:02.388427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-98701877-b935-413e-8a07-c58ff37c0c37 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Unhandled error: OSError: write error Jun 17 13:09:02.388427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:09:02.388427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:09:02.388752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 874/1655] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:09:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 0 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:09:02.510647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:09:02.511642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:09:02.517834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.518276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.519160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.519973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.549056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159532 Jun 17 13:09:02.549579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:09:02.549579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (10.222.0.87) Jun 17 13:09:02.550275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-2452dab9-b1c0-4d7a-86de-01e2c803d2d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Unhandled error: OSError: write error Jun 17 13:09:02.550275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:09:02.550275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:09:02.550662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 875/1656] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:09:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 0 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:09:02.554629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:09:02.555221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:09:02.560831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.561272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.562015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.562438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.626541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549a0df5e204b2b97bdcf4c745042c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eae9ef94ebe47e7a585d24d25930a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:09:02.635230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 200 len: 1226 microversion: 2.1 time: 0.083941 Jun 17 13:09:02.635786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (ip 10.222.0.87) !!! Jun 17 13:09:02.635786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:09:02 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (10.222.0.87) Jun 17 13:09:02.636359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-656b9705-cebb-4dcc-ba19-0cbccba29743 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Unhandled error: OSError: write error Jun 17 13:09:02.636359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:09:02.636359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:09:02.636622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 876/1657] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:09:02 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:09:02.640974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:09:02.641457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:09:02.647852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.648285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:02.649038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:02.649465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:03.287151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [0062dc67-0e30-4e55-89a4-3720ad1fc4ba] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 49972. Jun 17 13:09:03.291031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 202 len: 0 microversion: 2.1 time: 241.116241 Jun 17 13:09:03.291609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:09:03.291609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:09:03 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (10.222.0.87) Jun 17 13:09:03.292485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-fa3e756a-004e-447e-8b23-f07b6298eab3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Unhandled error: OSError: write error Jun 17 13:09:03.292485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:09:03.292485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:09:03.292807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 782/1658] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:05:02 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 0 bytes in 241119 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:09:03.298505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:09:03.299071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:09:03.306134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:03.306551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:03.307302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:09:03.307789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:09:12.645485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=10 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:09:12.667923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=28 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:09:13.303455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:09:13.329271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:10:07.271208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:10:07.272172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:10:14.998702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:10:14.999724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:10:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:11:02.393056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:11:02.455127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:11:12.397730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=4 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:11:12.459181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=4 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:11:40.342552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:11:40.345158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:11:44.025186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:11:44.026164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:11:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:12:11.432044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:12:11.432044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:12:49.974020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:49.976462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:49.978413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:49.979567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:49.981538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:49.983506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:49.986453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) Jun 17 13:12:49.988606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:49.990647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60ddebeb-1777-4d0b-a647-97ff8cedbcc0) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:49.990647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 227.341278 Jun 17 13:12:49.990647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:12:49.990647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (10.222.0.87) Jun 17 13:12:49.990647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-9131c69a-1531-4012-b156-af640eea8428 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Unhandled error: OSError: write error Jun 17 13:12:49.990647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:49.990647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:49.991506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 877/1659] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:09:02 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 0 bytes in 227343 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:49.991506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:49.991506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:49.995478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:49.995967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:49.996741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:49.997179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.022657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:50.028047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:50.029532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.030922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.032051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.033223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.034252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) Jun 17 13:12:50.035298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.040197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049261 Jun 17 13:12:50.040197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:50.040197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (10.222.0.87) Jun 17 13:12:50.040197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-2dfafe53-aac8-456a-8201-0ada374d8fd5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Unhandled error: OSError: write error Jun 17 13:12:50.040197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.040197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.040197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 878/1660] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.044469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7026c613-2a2a-4108-9da0-73545bb11ca6) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.044469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 226.748969 Jun 17 13:12:50.044469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:12:50.044469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (10.222.0.87) Jun 17 13:12:50.046427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-45442bec-a7da-4b5e-806c-d8c8b9881c47 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Unhandled error: OSError: write error Jun 17 13:12:50.046427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.046427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.046913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 783/1661] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:09:03 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 0 bytes in 226754 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.055071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.056802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.069797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.070468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.071521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.072719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.109522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061132 Jun 17 13:12:50.111987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:50.111987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (10.222.0.87) Jun 17 13:12:50.116174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-666f5ced-bb83-4304-8ef7-8b59789d8546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Unhandled error: OSError: write error Jun 17 13:12:50.116174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.116174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.116461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 784/1662] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.121190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.121794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.129025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.129551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.130731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.131171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.146763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:50.148465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.149839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.150662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.152108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.032622 Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (ip 10.222.0.87) !!! Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (10.222.0.87) Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-c0f89772-79a5-4d00-a3b4-69a2ae1b7d94 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Unhandled error: OSError: write error Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.153220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 785/1663] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 0 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.155636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.156117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.161851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.162293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.163045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.163510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.176694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.177312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.183455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.183898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.184661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.185164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.247021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:50.304390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:50.306541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:50.308111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.308747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.310027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.311314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.313277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) Jun 17 13:12:50.314615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.316392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50f609e1-8054-4ad0-b153-062e167cccfa) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.316392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 0.156124 Jun 17 13:12:50.316392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:12:50.316392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (10.222.0.87) Jun 17 13:12:50.316392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-b0b42dfe-5a6b-4421-b837-f4c61e20a535 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Unhandled error: OSError: write error Jun 17 13:12:50.316392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.316392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.317005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 786/1664] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:50 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 0 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.317005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.317005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.321019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.321547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.322383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.323555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.325227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:50.332891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.299770 Jun 17 13:12:50.333402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (ip 10.222.0.87) !!! Jun 17 13:12:50.333402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (10.222.0.87) Jun 17 13:12:50.333982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-a7a2dc55-026d-4deb-929d-93f8507a8492 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Unhandled error: OSError: write error Jun 17 13:12:50.333982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.333982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.334238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 879/1665] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 0 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.338654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.339668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.345535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.345974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.346757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.347184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.376426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Jun 17 13:12:50.376850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:50.376850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (10.222.0.87) Jun 17 13:12:50.377429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-92f5447d-8471-4335-90e5-6604561c1693 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Unhandled error: OSError: write error Jun 17 13:12:50.377429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.377429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.377684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 880/1666] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.382263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.382857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.388781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.389225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.390154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.390574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.406552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:50.461788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:50.464015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:50.465655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.466398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.468312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.474193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) Jun 17 13:12:50.478045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.480871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cc8ee0f-e2e4-43af-ac7a-fa4d9ce53b5e) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.480871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.155226 Jun 17 13:12:50.480871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:12:50.480871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (10.222.0.87) Jun 17 13:12:50.480871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-e6137282-f9d8-4a9b-b2a7-3d3122641587 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Unhandled error: OSError: write error Jun 17 13:12:50.480871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.480871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.482229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 787/1667] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:50 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 0 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.482229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.482229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.482229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.482821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.482821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.482821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.512618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044814 Jun 17 13:12:50.513135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:50.513135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (10.222.0.87) Jun 17 13:12:50.513713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-588f37b6-1457-4c66-be84-0a377c38ad9f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Unhandled error: OSError: write error Jun 17 13:12:50.513713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.513713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.514198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 788/1668] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.518259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.518840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.525046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.525480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.526276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.526522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:50.526731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.534199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.155710 Jun 17 13:12:50.534706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (ip 10.222.0.87) !!! Jun 17 13:12:50.534706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (10.222.0.87) Jun 17 13:12:50.535282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-e66291f3-5175-48fb-ac87-9b8e2095f906 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Unhandled error: OSError: write error Jun 17 13:12:50.535282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.535282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.535587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 881/1669] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 0 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.539956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.540380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.540507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:50.541916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.543285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.544086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.545367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.028570 Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (ip 10.222.0.87) !!! Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (10.222.0.87) Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-91485e80-11a3-432d-8e1d-35906b0d8385 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Unhandled error: OSError: write error Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.546581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 789/1670] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.547119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.547119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.547869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.548209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.549631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.550112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.555880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.556482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.557237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.557666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.628785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:50.673811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:50.700715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:50.703179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:50.704769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.705647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.706694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.707908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.709106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) Jun 17 13:12:50.710291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e4e549b-9256-4cba-a470-310dbaaa870f) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 0.168290 Jun 17 13:12:50.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:12:50.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (10.222.0.87) Jun 17 13:12:50.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-ebfc7bb1-01cc-48ee-be0c-edbbbb05abdb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Unhandled error: OSError: write error Jun 17 13:12:50.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.713008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 882/1671] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:50 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 0 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.713008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.713008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.718908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.719888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.720191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.720545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.736217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:50.738520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:50.739898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.740551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.741558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.742702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.743782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) Jun 17 13:12:50.744869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.745910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3591dd0f-b122-4eec-8059-5777ec014704) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.745910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.194657 Jun 17 13:12:50.745910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:12:50.745910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (10.222.0.87) Jun 17 13:12:50.745910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-74eec4e5-d3eb-48aa-bbfc-30559c8d18c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Unhandled error: OSError: write error Jun 17 13:12:50.745910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.745910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.746397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 790/1672] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:50 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 0 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.746397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.746397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.750553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Jun 17 13:12:50.751054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:50.751054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (10.222.0.87) Jun 17 13:12:50.751659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-dfbc1026-612c-497c-9418-da032205f9b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Unhandled error: OSError: write error Jun 17 13:12:50.751659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.751659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.751924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 883/1673] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.752868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.753308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.754059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.754481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.756647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.757525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.763235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.763709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.764532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.764962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.794139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041373 Jun 17 13:12:50.794645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:50.794645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (10.222.0.87) Jun 17 13:12:50.795399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-660202f5-4350-434a-809f-9005863d542c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Unhandled error: OSError: write error Jun 17 13:12:50.795399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.795399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.796293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 884/1674] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.800004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.800528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.806352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.806798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.807587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.808017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.821505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:50.823049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.824637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.825514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:50.827062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.028045 Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (ip 10.222.0.87) !!! Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (10.222.0.87) Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-70125ffa-d7ae-4ae4-bfe8-8b72e5c60e58 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Unhandled error: OSError: write error Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.829090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 885/1675] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 0 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.830105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.830580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.836404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.836844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.837604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.838022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.897000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:50.905855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.163871 Jun 17 13:12:50.906445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (ip 10.222.0.87) !!! Jun 17 13:12:50.906445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (10.222.0.87) Jun 17 13:12:50.907128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-12840d53-7b0a-44a6-90dd-2233a4698deb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Unhandled error: OSError: write error Jun 17 13:12:50.907128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:50.907128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:50.907410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 791/1676] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 0 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.912080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.912630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.918817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.919248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.920173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.921189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.921927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:50.977875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:50.980054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:50.981599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.982599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:50.984072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.985435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.986917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) Jun 17 13:12:50.988345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:50.989575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d274cce-fc1f-4b5c-ac73-977f63429a6a) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:50.989575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 0.155030 Jun 17 13:12:50.989575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (ip 10.222.0.87) !!! Jun 17 13:12:50.989575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:50 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d (10.222.0.87) Jun 17 13:12:50.989575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-797dd74f-168a-45e4-a909-63f30f15f17a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Unhandled error: OSError: write error Jun 17 13:12:50.989575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:50.989575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:50.990137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 886/1677] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:50 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 0 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:50.990137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:50.990776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:50.997035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.997456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:50.998254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:50.998655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.028473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:51.032123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047755 Jun 17 13:12:51.032637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:51.032761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:51 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments (10.222.0.87) Jun 17 13:12:51.033273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-a9a67fef-ebc2-4a31-b7e3-4ce9a0c3fd9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Unhandled error: OSError: write error Jun 17 13:12:51.033273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:51.033273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:51.033598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 887/1678] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:51.038425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.039021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.045133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.045610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.046356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.046782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.085695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:51.087928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:51.089258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.089880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.090944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.092242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) Jun 17 13:12:51.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.096593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-802ab4de-72f5-4a1a-af62-d0d647c0e1c9) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.096593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.181013 Jun 17 13:12:51.096593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (ip 10.222.0.87) !!! Jun 17 13:12:51.096593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:51 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 (10.222.0.87) Jun 17 13:12:51.096593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-2d66eb71-41b0-45de-af66-0506d3f606f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Unhandled error: OSError: write error Jun 17 13:12:51.096593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:51.096593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:51.097267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 792/1679] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:50 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 0 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:51.097267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.097267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.103111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.103598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.104373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.104805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.135280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043705 Jun 17 13:12:51.135819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (ip 10.222.0.87) !!! Jun 17 13:12:51.135819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:51 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments (10.222.0.87) Jun 17 13:12:51.136396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-75be7d8b-8efc-4427-b152-ac731aa55d08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Unhandled error: OSError: write error Jun 17 13:12:51.136396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:51.136396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:51.136680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 793/1680] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:51.140938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.141536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.147444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.147831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.148595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.149025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.162350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:51.163904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.165518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.166424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.167926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.027881 Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (ip 10.222.0.87) !!! Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:12:51 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee (10.222.0.87) Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: CRITICAL nova [None req-a536f625-5f32-49b5-b3a5-827aabbc99cc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Unhandled error: OSError: write error Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova OSError: write error Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova Jun 17 13:12:51.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 794/1681] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 0 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:51.171003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.171604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.177367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.177815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.178570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.178998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.188198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:51.196029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.161714 Jun 17 13:12:51.196518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (ip 10.222.0.87) !!! Jun 17 13:12:51.196518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:12:51 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f (10.222.0.87) Jun 17 13:12:51.197098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: CRITICAL nova [None req-a0d64bb1-aceb-4a34-adcb-fd9340a52419 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Unhandled error: OSError: write error Jun 17 13:12:51.197098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova OSError: write error Jun 17 13:12:51.197098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova Jun 17 13:12:51.197460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 888/1682] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:51.201745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.202233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.209982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.210429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.211192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.211652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.260329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:51.302246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:51.329615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:51.331888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:51.333224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.334111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.335136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.336323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.337371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) Jun 17 13:12:51.338491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.339621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0db9814a-7434-48c7-a991-1f01ed08f869) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.339621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6f5a5ca4-21ed-4ca4-9e03-110f5d3e200d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 0.166137 Jun 17 13:12:51.339621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 795/1683] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:51 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:51.339621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b506c7c6-b314-4886-976f-1ad22d6351db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.339942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b506c7c6-b314-4886-976f-1ad22d6351db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.346108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b506c7c6-b314-4886-976f-1ad22d6351db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.346554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b506c7c6-b314-4886-976f-1ad22d6351db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.347316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b506c7c6-b314-4886-976f-1ad22d6351db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.347784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b506c7c6-b314-4886-976f-1ad22d6351db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.363543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:51.365752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:51.367229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.369485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.371140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.372555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) Jun 17 13:12:51.374487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.376002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00bc11cc-b101-4e5a-8c55-cbb526abe14c) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.376002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bc81d720-74a0-4272-896d-7341400c24f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.169129 Jun 17 13:12:51.376002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 889/1684] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:51 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:51.376002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.376364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.379922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.380732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.381500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.381926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.382038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b506c7c6-b314-4886-976f-1ad22d6351db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Jun 17 13:12:51.382696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 796/1685] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:51.387284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-22c88040-c962-42d9-8701-91c2bcfde857 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.388233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-22c88040-c962-42d9-8701-91c2bcfde857 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.394073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22c88040-c962-42d9-8701-91c2bcfde857 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.394516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22c88040-c962-42d9-8701-91c2bcfde857 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.395302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22c88040-c962-42d9-8701-91c2bcfde857 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.395871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-22c88040-c962-42d9-8701-91c2bcfde857 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.425380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-22c88040-c962-42d9-8701-91c2bcfde857 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041501 Jun 17 13:12:51.425874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 797/1686] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:12:51.430284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.430881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.436903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.437337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.438091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.438515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.453112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:51.454676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.456169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.456905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.458101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.459273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.459273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3d995816-57a6-45a9-b4fb-d40c352f77fd tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.029294 Jun 17 13:12:51.459273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 798/1687] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:12:51.461145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.461626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.467675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.468119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.468877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.469304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.522061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:51.529899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-570da71e-ad37-4549-9237-d79332e747da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.161011 Jun 17 13:12:51.530474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 890/1688] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:51.535044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.535584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.541329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.541763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.542475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.543013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.551705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:51.627316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:51.657136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:51.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:51.660738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.661793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.662847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.664134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.665139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) Jun 17 13:12:51.666232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.667305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-861e30d0-8401-40d7-84e0-8fe76fc289d8) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.667305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0cff9819-566e-4beb-93ca-2d7c6024ca52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 0.203465 Jun 17 13:12:51.667305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 799/1689] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:51 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 269 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:51.667838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f70c54d6-1ea2-44e7-8635-b490efc07ec1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.668927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f70c54d6-1ea2-44e7-8635-b490efc07ec1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.675939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f70c54d6-1ea2-44e7-8635-b490efc07ec1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.676444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f70c54d6-1ea2-44e7-8635-b490efc07ec1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.677071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f70c54d6-1ea2-44e7-8635-b490efc07ec1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.677498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f70c54d6-1ea2-44e7-8635-b490efc07ec1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.692438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:51.694730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:51.696379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.697250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.698621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.700196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.701928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) Jun 17 13:12:51.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.704511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6b779686-d22c-4aa6-a9df-5485e071a323) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.704511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-82cde792-0083-4a3a-8176-d774ca551f79 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.164820 Jun 17 13:12:51.704511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 891/1690] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:51 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 269 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:51.704511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.705084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.707204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f70c54d6-1ea2-44e7-8635-b490efc07ec1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Jun 17 13:12:51.707799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 800/1691] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:51.709496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.710044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.710813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.711244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.712427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-462a204d-65cd-40d5-a355-dc04d91a05b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.713434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-462a204d-65cd-40d5-a355-dc04d91a05b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.719481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462a204d-65cd-40d5-a355-dc04d91a05b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.719929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462a204d-65cd-40d5-a355-dc04d91a05b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.720687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462a204d-65cd-40d5-a355-dc04d91a05b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.721123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462a204d-65cd-40d5-a355-dc04d91a05b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.725600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:51.750201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-462a204d-65cd-40d5-a355-dc04d91a05b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041322 Jun 17 13:12:51.750761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 801/1692] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:12:51.755564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.756167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.762003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.762491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.763234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.763708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.777224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:51.778769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.780690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.781447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:51.782688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.783785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.783785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34e229c8-7444-4faf-9947-1bb0bd03ac16 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.028565 Jun 17 13:12:51.783785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 802/1693] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:12:51.785490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.785969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.791859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.792300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.793066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.793498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.857389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:51.865179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f80ec815-197b-4272-98b8-608cfc02017d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.167295 Jun 17 13:12:51.865621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 892/1694] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:51.872317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.872805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.874541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:51.879653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.880454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.881416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.881843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.945040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:51.947399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:51.948737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.949353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:51.950398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.952031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.953086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) Jun 17 13:12:51.954158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:51.955462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0240a31-f4ef-45a5-be5c-8bf0f4110d30) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:51.955462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5040a40d-9cfc-4e16-a6fb-394f765f4b2e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 0.167220 Jun 17 13:12:51.955462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 803/1695] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:51 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 269 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:51.955462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e61347d4-46cf-4731-b2ab-a822a769e726 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:51.955793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e61347d4-46cf-4731-b2ab-a822a769e726 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:51.962168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e61347d4-46cf-4731-b2ab-a822a769e726 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.962609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e61347d4-46cf-4731-b2ab-a822a769e726 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.963534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e61347d4-46cf-4731-b2ab-a822a769e726 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:51.963957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e61347d4-46cf-4731-b2ab-a822a769e726 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:51.996200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e61347d4-46cf-4731-b2ab-a822a769e726 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Jun 17 13:12:51.996728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 804/1696] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:51.999076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:52.001864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.002589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.003276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:52.008904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.009329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.010082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.010513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.061187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:52.063398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:52.064994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.065928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.067195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.068639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.069880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) Jun 17 13:12:52.071181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.072467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f891b30-428a-4b88-bf26-d4aff9c105f3) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:52.072467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ba0e0885-07f2-453e-ba6b-ea9e95784010 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.196419 Jun 17 13:12:52.072467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 893/1697] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:51 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 269 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:52.072467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7c265cfe-7ede-4473-89da-6d5a2d95d0d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.072888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7c265cfe-7ede-4473-89da-6d5a2d95d0d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.080110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c265cfe-7ede-4473-89da-6d5a2d95d0d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.080559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c265cfe-7ede-4473-89da-6d5a2d95d0d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.081327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c265cfe-7ede-4473-89da-6d5a2d95d0d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.081760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7c265cfe-7ede-4473-89da-6d5a2d95d0d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.116728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7c265cfe-7ede-4473-89da-6d5a2d95d0d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049909 Jun 17 13:12:52.116897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 894/1698] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:12:52.121619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.122223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.128558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.129000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.129759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.130556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.144090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:52.145631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.147018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:52.147800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.149035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.150135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:52.150135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-84565df1-0b14-4459-a907-8d688bf8f6e6 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.028991 Jun 17 13:12:52.150135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 895/1699] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:12:52.152526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.152739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.160411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.160857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.161665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.162095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.164598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:52.173276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8590d88a-5922-4cf9-b82f-6d071e3cd246 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.175405 Jun 17 13:12:52.173884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 805/1700] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:52.178724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.179436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.185585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.186137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.187006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.187475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.243758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'services' on Instance uuid cf52b0f3-44a6-4d5c-82fb-e662f185c898 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:52.289771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:52.327348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d HTTP/1.1 Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:52.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:12:52.331195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898', 'id': '625a8a3e-6743-46f5-9ea1-2a5a66aac92d'} Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.332228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.333701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.336639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.337971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) Jun 17 13:12:52.339308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.340602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f94ce70-d5af-45f2-9f56-543b4002675c) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:52.340602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-33298f73-7c29-4087-b534-68edf49178fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d" status: 400 len: 269 microversion: 2.1 time: 0.182603 Jun 17 13:12:52.340602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 896/1701] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:52 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments/625a8a3e-6743-46f5-9ea1-2a5a66aac92d => generated 269 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:52.340602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-51b6cfd6-f216-4b40-b108-ce76f5444608 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.340959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-51b6cfd6-f216-4b40-b108-ce76f5444608 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.344576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51b6cfd6-f216-4b40-b108-ce76f5444608 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.345010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51b6cfd6-f216-4b40-b108-ce76f5444608 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.345758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51b6cfd6-f216-4b40-b108-ce76f5444608 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.346181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51b6cfd6-f216-4b40-b108-ce76f5444608 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.363841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:52.365998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:52.367582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.368326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.369661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.371109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.372435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) Jun 17 13:12:52.374329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.376178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-977d9557-79f8-46fb-ae93-8215b629beaf) {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:52.376178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a5f12c3-5de7-4f4f-8b1b-6354be15df0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.192598 Jun 17 13:12:52.376178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 806/1702] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:52 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 269 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:52.376178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.376622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.377397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-51b6cfd6-f216-4b40-b108-ce76f5444608 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Jun 17 13:12:52.377956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 897/1703] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:52.381269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.381711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.382469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.382897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.383041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-528a7055-7c81-4818-8045-6a00b5d653cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.383902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-528a7055-7c81-4818-8045-6a00b5d653cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.389832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-528a7055-7c81-4818-8045-6a00b5d653cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.390278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-528a7055-7c81-4818-8045-6a00b5d653cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.391036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-528a7055-7c81-4818-8045-6a00b5d653cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.391498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-528a7055-7c81-4818-8045-6a00b5d653cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.420640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-528a7055-7c81-4818-8045-6a00b5d653cc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041157 Jun 17 13:12:52.421570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 898/1704] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:12:52.426044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.427797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.433998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.434441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.435210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.435732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.451288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:52.452911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.454348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:52.455087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.456429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.458016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:52.458016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-307c61c5-d66d-473e-897a-9c10e4902c52 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.031781 Jun 17 13:12:52.458016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 899/1705] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:12:52.460683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-92714249-d64b-49a9-941a-07d49a66d504 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.461620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-92714249-d64b-49a9-941a-07d49a66d504 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.468768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92714249-d64b-49a9-941a-07d49a66d504 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.469914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92714249-d64b-49a9-941a-07d49a66d504 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.470306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92714249-d64b-49a9-941a-07d49a66d504 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.470586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92714249-d64b-49a9-941a-07d49a66d504 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.500948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-92714249-d64b-49a9-941a-07d49a66d504 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Jun 17 13:12:52.501697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 900/1706] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:52.506500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.506975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.514670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.515109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.515906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.516334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.568436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:52.576651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b6c657e3-879d-4962-a80b-e36964796798 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.206897 Jun 17 13:12:52.577644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 807/1707] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:52.583008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-170ae0d7-831e-46cb-8b75-81ba3d9cf91a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.584259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-170ae0d7-831e-46cb-8b75-81ba3d9cf91a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.590610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-170ae0d7-831e-46cb-8b75-81ba3d9cf91a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.591086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-170ae0d7-831e-46cb-8b75-81ba3d9cf91a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.591898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-170ae0d7-831e-46cb-8b75-81ba3d9cf91a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.594363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-170ae0d7-831e-46cb-8b75-81ba3d9cf91a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.603017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 067c508e-8040-41dd-bc09-07434f2ed0af {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:52.630577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-170ae0d7-831e-46cb-8b75-81ba3d9cf91a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051423 Jun 17 13:12:52.631159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 808/1708] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:52.636484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.637086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.644386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.645092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.645873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.646303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.662824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 HTTP/1.1 Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:52.665003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:12:52.666659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'server_id': '067c508e-8040-41dd-bc09-07434f2ed0af', 'id': '02972020-3095-4b5a-abbb-a873606484f8'} Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.667435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:52.668575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.669868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.671133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) Jun 17 13:12:52.672445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.674408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48db5031-fab9-4533-a875-6a77008c93a4) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:52.675272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f83f8b3a-8856-4200-b1d1-df8b795d9b5f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8" status: 400 len: 269 microversion: 2.1 time: 0.172866 Jun 17 13:12:52.675868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 901/1709] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:52 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af/os-volume_attachments/02972020-3095-4b5a-abbb-a873606484f8 => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:52.680774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1ae4167-8f3a-4292-b703-0e33baad5d31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.681778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1ae4167-8f3a-4292-b703-0e33baad5d31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.688957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ae4167-8f3a-4292-b703-0e33baad5d31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.689468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ae4167-8f3a-4292-b703-0e33baad5d31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.690335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ae4167-8f3a-4292-b703-0e33baad5d31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.690828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ae4167-8f3a-4292-b703-0e33baad5d31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.724790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1ae4167-8f3a-4292-b703-0e33baad5d31 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047633 Jun 17 13:12:52.725443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 902/1710] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:12:52.738181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.738181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.738418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.738906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.739706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.740133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.753710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:52.755650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.757282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:52.758208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:52.759499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:52.760595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:52.760595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-89ffc314-85a7-4829-8c7d-fcfdcc613bdc tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.030454 Jun 17 13:12:52.760595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 903/1711] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:12:52.762031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-89933749-79ee-4bca-9c80-6fd0dfb15937 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:52.762940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-89933749-79ee-4bca-9c80-6fd0dfb15937 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:52.772362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89933749-79ee-4bca-9c80-6fd0dfb15937 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.772819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89933749-79ee-4bca-9c80-6fd0dfb15937 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.773595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89933749-79ee-4bca-9c80-6fd0dfb15937 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:52.774025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89933749-79ee-4bca-9c80-6fd0dfb15937 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:52.805474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-89933749-79ee-4bca-9c80-6fd0dfb15937 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046894 Jun 17 13:12:52.806033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 904/1712] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:52.814096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2132137990", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1048624945", "security_groups": [{"name": "tempest-secgroup-smoke-1784971003"}], "block_device_mapping_v2": [{"uuid": "5855a8fd-1413-47c9-b0b0-60437fbea262", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6731f394-dd14-4b07-ad91-ba8e0da29052"}]}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:12:52.937856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] validate_networks() for [('6731f394-dd14-4b07-ad91-ba8e0da29052', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:12:53.105439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:53.113714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6c153473-b614-4559-9b92-ff2e9880110b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1559 microversion: 2.1 time: 0.481476 Jun 17 13:12:53.114611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 809/1713] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1559 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:53.390316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:12:53.390847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:12:53.391212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:12:53.391677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:12:53.392091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:12:53.402522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.402960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.403795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.404261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.422043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Getting quotas for project 6eae9ef94ebe47e7a585d24d25930a82. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:12:53.426566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Getting quotas for user 0549a0df5e204b2b97bdcf4c745042c7 and project 6eae9ef94ebe47e7a585d24d25930a82. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:12:53.491771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:12:53.493891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 5b28e2eb-7227-441d-bf47-6b3db008354b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5855a8fd-1413-47c9-b0b0-60437fbea262',volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:12:53.512816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6204b927-c937-443b-aa05-78636e32269e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:53.514799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6204b927-c937-443b-aa05-78636e32269e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:53.521679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6204b927-c937-443b-aa05-78636e32269e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.522128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6204b927-c937-443b-aa05-78636e32269e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.522903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6204b927-c937-443b-aa05-78636e32269e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.523336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6204b927-c937-443b-aa05-78636e32269e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.553701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6204b927-c937-443b-aa05-78636e32269e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Jun 17 13:12:53.558334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 810/1714] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:53.565339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 478 Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:53.569445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:53.570990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {"server": {"name": "tempest-TestVolumeBootPattern-server-2132137990", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1048624945", "security_groups": [{"name": "tempest-secgroup-smoke-1784971003"}], "block_device_mapping_v2": [{"uuid": "5855a8fd-1413-47c9-b0b0-60437fbea262", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6731f394-dd14-4b07-ad91-ba8e0da29052"}]}} Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-2132137990', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-1048624945', 'security_groups': [{'name': 'tempest-secgroup-smoke-1784971003'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '5855a8fd-1413-47c9-b0b0-60437fbea262'}], 'networks': [{'uuid': '6731f394-dd14-4b07-ad91-ba8e0da29052'}]}}} Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:53.571888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:53.572775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:53.574325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:53.575838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 13:12:53.577545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._validate_bdm( Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:53.578931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:53.580551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:53.582185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) Jun 17 13:12:53.582185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:53.582185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 5855a8fd-1413-47c9-b0b0-60437fbea262 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-210e06de-f9d7-4011-96ef-46375c331977) {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:53.582185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98ccff6b-5be9-4073-a89b-1a6e260520ad tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 0.760904 Jun 17 13:12:53.582185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 905/1715] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 13:12:52 2022] POST /compute/v2.1/servers => generated 295 bytes in 762 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 13:12:53.643698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-38654921-7c7e-4e5c-991d-bc06b5e9e490 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:12:53.644997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-38654921-7c7e-4e5c-991d-bc06b5e9e490 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:53.652459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38654921-7c7e-4e5c-991d-bc06b5e9e490 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.653051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38654921-7c7e-4e5c-991d-bc06b5e9e490 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.653831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38654921-7c7e-4e5c-991d-bc06b5e9e490 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.654260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38654921-7c7e-4e5c-991d-bc06b5e9e490 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.740815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-38654921-7c7e-4e5c-991d-bc06b5e9e490 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/action" status: 200 len: 41003 microversion: 2.1 time: 0.101692 Jun 17 13:12:53.750413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-817bcc90-5bf4-4b4b-a282-36bef0dc8a96 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:12:53.752307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 811/1716] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 13:12:53 2022] POST /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75/action => generated 41003 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:12:53.753507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-817bcc90-5bf4-4b4b-a282-36bef0dc8a96 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:53.762611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-817bcc90-5bf4-4b4b-a282-36bef0dc8a96 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.763061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-817bcc90-5bf4-4b4b-a282-36bef0dc8a96 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.763987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-817bcc90-5bf4-4b4b-a282-36bef0dc8a96 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.764706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-817bcc90-5bf4-4b4b-a282-36bef0dc8a96 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.824081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b9e9e854-53f4-48fe-b137-0c4c8701bab6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:53.825363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b9e9e854-53f4-48fe-b137-0c4c8701bab6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:53.840960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e9e854-53f4-48fe-b137-0c4c8701bab6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.843012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e9e854-53f4-48fe-b137-0c4c8701bab6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.843860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-817bcc90-5bf4-4b4b-a282-36bef0dc8a96 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/action" status: 200 len: 38060 microversion: 2.20 time: 0.108777 Jun 17 13:12:53.845171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 906/1717] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Jun 17 13:12:53 2022] POST /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43/action => generated 38060 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:12:53.845405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e9e854-53f4-48fe-b137-0c4c8701bab6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:53.851019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9e9e854-53f4-48fe-b137-0c4c8701bab6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:53.886308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b9e9e854-53f4-48fe-b137-0c4c8701bab6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072302 Jun 17 13:12:53.886876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 812/1718] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:54.102244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:54.102909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:54.110802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.111341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.112232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.112664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.127192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:12:54.128959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.130679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:54.131476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.132669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.133875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:54.133875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-abd584f0-7d45-4241-980e-36198454c685 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "DELETE /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.032526 Jun 17 13:12:54.133875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 907/1719] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:12:54 2022] DELETE /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:12:54.140109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:54.140757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] [instance: 556e3927-0db8-47b5-a3f0-f0338fd92dee] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:54.147026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.147503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.148263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.148666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.162498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] HTTP exception thrown: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Request method failure captured: Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee HTTP/1.1 Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHk4bZYNxBHDChMVXEan9-F1ojiwd1Cw6YrURkLRBGxK2lU12KtOCmhQhekOo2YRzfk-rDRcR2ssiASewiT5K3IB2QuqCkIcDOYCAq8idfNep6VRiDMq3fIBp0CShqARt7_ifSc0qJ34q56SMEmFdRf59D52taBCs7zV-GAgtwAyRTA Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:12:54.164205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6eae9ef94ebe47e7a585d24d25930a82", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6eae9ef94ebe47e7a585d24d25930a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 6eae9ef94ebe47e7a585d24d25930a82 Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestVolumeBootPattern-2141443264 Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 0549a0df5e204b2b97bdcf4c745042c7 Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestVolumeBootPattern-2141443264-project Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.165858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '556e3927-0db8-47b5-a3f0-f0338fd92dee'} Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:54.166825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. Jun 17 13:12:54.168564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:12:54.170592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Returning 404 to user: Instance 556e3927-0db8-47b5-a3f0-f0338fd92dee could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:54.170592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-58c7a293-1d2b-40c3-b4ab-e36c9f191161 tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee" status: 404 len: 111 microversion: 2.1 time: 0.029925 Jun 17 13:12:54.170592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 813/1720] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:54 2022] GET /compute/v2.1/servers/556e3927-0db8-47b5-a3f0-f0338fd92dee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:12:54.288946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:54.289777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:54.301696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.302401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.303190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.303736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.331798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:12:54.354659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-1a785b1d-d1e3-4147-a952-6a29c6c5e368 req-adba9dc9-385b-40ef-837c-ff7ba8e6c578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e78628d-5386-4d24-adb0-9ea06bce2e6f", "tag": "f207d69b-630e-4aae-8a6c-17febe0a96eb"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:12:54.365754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-1a785b1d-d1e3-4147-a952-6a29c6c5e368 req-adba9dc9-385b-40ef-837c-ff7ba8e6c578 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.366572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-1a785b1d-d1e3-4147-a952-6a29c6c5e368 req-adba9dc9-385b-40ef-837c-ff7ba8e6c578 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.377978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-1a785b1d-d1e3-4147-a952-6a29c6c5e368 req-adba9dc9-385b-40ef-837c-ff7ba8e6c578 service nova] Creating event network-changed:f207d69b-630e-4aae-8a6c-17febe0a96eb for instance 7e78628d-5386-4d24-adb0-9ea06bce2e6f on hv-cinder-84617 Jun 17 13:12:54.383765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-1a785b1d-d1e3-4147-a952-6a29c6c5e368 req-adba9dc9-385b-40ef-837c-ff7ba8e6c578 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096756 Jun 17 13:12:54.384570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 814/1721] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:12:54.421685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fbc92a1c-4fde-4402-b0be-64f5f1dde82b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 204 len: 0 microversion: 2.1 time: 0.136806 Jun 17 13:12:54.422437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 908/1722] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:12:54 2022] DELETE /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:12:54.431099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:54.434466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:54.441658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.442118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.442888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.443580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.567243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8482399f-ce8a-435a-9a7c-5aac643e45e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:54.568248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8482399f-ce8a-435a-9a7c-5aac643e45e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:54.575596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8482399f-ce8a-435a-9a7c-5aac643e45e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.576081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8482399f-ce8a-435a-9a7c-5aac643e45e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.577639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8482399f-ce8a-435a-9a7c-5aac643e45e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.578062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8482399f-ce8a-435a-9a7c-5aac643e45e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.586733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:54.596098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8f66d287-bc34-4b4a-956e-b7f36a1fe68b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1565 microversion: 2.1 time: 0.169193 Jun 17 13:12:54.606190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 815/1723] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:54.611015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8482399f-ce8a-435a-9a7c-5aac643e45e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Jun 17 13:12:54.611621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 909/1724] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:54.900681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd872601-8280-4302-99d4-098df53b3386 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:54.902045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd872601-8280-4302-99d4-098df53b3386 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:54.911682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd872601-8280-4302-99d4-098df53b3386 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.916297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd872601-8280-4302-99d4-098df53b3386 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.917485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd872601-8280-4302-99d4-098df53b3386 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:54.918130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd872601-8280-4302-99d4-098df53b3386 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:54.983122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd872601-8280-4302-99d4-098df53b3386 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086274 Jun 17 13:12:54.989464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 816/1725] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:54 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:55.537734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-b15cf6ff-033f-44ca-b99c-3be46270f599 req-5ee0d27f-bcbe-4332-9694-103b6b892f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e78628d-5386-4d24-adb0-9ea06bce2e6f", "name": "network-vif-deleted", "tag": "f207d69b-630e-4aae-8a6c-17febe0a96eb"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:12:55.546980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-b15cf6ff-033f-44ca-b99c-3be46270f599 req-5ee0d27f-bcbe-4332-9694-103b6b892f7d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:55.547453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-b15cf6ff-033f-44ca-b99c-3be46270f599 req-5ee0d27f-bcbe-4332-9694-103b6b892f7d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:55.559149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-b15cf6ff-033f-44ca-b99c-3be46270f599 req-5ee0d27f-bcbe-4332-9694-103b6b892f7d service nova] Creating event network-vif-deleted:f207d69b-630e-4aae-8a6c-17febe0a96eb for instance 7e78628d-5386-4d24-adb0-9ea06bce2e6f on hv-cinder-84617 Jun 17 13:12:55.564994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-b15cf6ff-033f-44ca-b99c-3be46270f599 req-5ee0d27f-bcbe-4332-9694-103b6b892f7d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091698 Jun 17 13:12:55.565582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 910/1726] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:12:55.614629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:55.615553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:55.622540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f8d2ec43-71f9-4424-8652-59a655857b10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:55.622873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:55.623429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:55.623937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f8d2ec43-71f9-4424-8652-59a655857b10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:55.624239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:55.624858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:55.631010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8d2ec43-71f9-4424-8652-59a655857b10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:55.631480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8d2ec43-71f9-4424-8652-59a655857b10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:55.632261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8d2ec43-71f9-4424-8652-59a655857b10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:55.632685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8d2ec43-71f9-4424-8652-59a655857b10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:55.666112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f8d2ec43-71f9-4424-8652-59a655857b10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047844 Jun 17 13:12:55.666772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 911/1727] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:55 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:55.702786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:55.711671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9c5fb116-95e8-45ea-acc3-73fba571e0f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1380 microversion: 2.1 time: 0.101062 Jun 17 13:12:55.712339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 817/1728] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1380 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:56.001271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f996e264-981e-4ba3-b8f3-e7752eaff9e9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:56.003047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f996e264-981e-4ba3-b8f3-e7752eaff9e9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:56.014881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f996e264-981e-4ba3-b8f3-e7752eaff9e9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:56.015287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f996e264-981e-4ba3-b8f3-e7752eaff9e9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:56.016094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f996e264-981e-4ba3-b8f3-e7752eaff9e9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:56.016526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f996e264-981e-4ba3-b8f3-e7752eaff9e9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:56.020375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:56.048393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f996e264-981e-4ba3-b8f3-e7752eaff9e9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055032 Jun 17 13:12:56.049109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 912/1729] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:56.679034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-36260338-b82a-47f9-817d-1dbd85df6c36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:56.680029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-36260338-b82a-47f9-817d-1dbd85df6c36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:56.687201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36260338-b82a-47f9-817d-1dbd85df6c36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:56.687714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36260338-b82a-47f9-817d-1dbd85df6c36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:56.688887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36260338-b82a-47f9-817d-1dbd85df6c36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:56.689321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36260338-b82a-47f9-817d-1dbd85df6c36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:56.718766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-36260338-b82a-47f9-817d-1dbd85df6c36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 Jun 17 13:12:56.719691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 818/1730] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:56.730380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:56.731185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:56.739983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:56.740534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:56.741650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:56.742262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:56.810968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:56.819694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-924493ed-381a-4e38-9452-e2c313e34b73 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093810 Jun 17 13:12:56.820182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 913/1731] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:57.063446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a8abd0dc-d4e9-4076-8db9-e7c64de4ac89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:57.064675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a8abd0dc-d4e9-4076-8db9-e7c64de4ac89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:57.074473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8abd0dc-d4e9-4076-8db9-e7c64de4ac89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:57.075060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8abd0dc-d4e9-4076-8db9-e7c64de4ac89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:57.076249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8abd0dc-d4e9-4076-8db9-e7c64de4ac89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:57.076925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8abd0dc-d4e9-4076-8db9-e7c64de4ac89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:57.094761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:57.108665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a8abd0dc-d4e9-4076-8db9-e7c64de4ac89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051863 Jun 17 13:12:57.109229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 819/1732] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:57 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:57.731569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-99f129b4-bfa4-4995-a1dd-2ff3e6f30d28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:57.732597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-99f129b4-bfa4-4995-a1dd-2ff3e6f30d28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:57.739777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99f129b4-bfa4-4995-a1dd-2ff3e6f30d28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:57.740254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99f129b4-bfa4-4995-a1dd-2ff3e6f30d28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:57.741018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99f129b4-bfa4-4995-a1dd-2ff3e6f30d28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:57.741450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99f129b4-bfa4-4995-a1dd-2ff3e6f30d28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:57.772941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-99f129b4-bfa4-4995-a1dd-2ff3e6f30d28 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 Jun 17 13:12:57.773497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 914/1733] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:57.837549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:57.838113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:57.845175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:57.845655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:57.846429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:57.846857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:57.915567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:57.923243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4e56725b-5507-41b9-a795-ca99e5823071 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089636 Jun 17 13:12:57.923840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 820/1734] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:58.121586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-555cd796-de62-4298-89f4-e8c764115a97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:58.122518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-555cd796-de62-4298-89f4-e8c764115a97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:58.129332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-555cd796-de62-4298-89f4-e8c764115a97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:58.129780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-555cd796-de62-4298-89f4-e8c764115a97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:58.130909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-555cd796-de62-4298-89f4-e8c764115a97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:58.131339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-555cd796-de62-4298-89f4-e8c764115a97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:58.161143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-555cd796-de62-4298-89f4-e8c764115a97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Jun 17 13:12:58.161710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 915/1735] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:58 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:58.788827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-445ca05e-6ca4-46ca-aaa1-90932ac67288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:58.789916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-445ca05e-6ca4-46ca-aaa1-90932ac67288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:58.796354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-445ca05e-6ca4-46ca-aaa1-90932ac67288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:58.796824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-445ca05e-6ca4-46ca-aaa1-90932ac67288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:58.797635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-445ca05e-6ca4-46ca-aaa1-90932ac67288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:58.798113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-445ca05e-6ca4-46ca-aaa1-90932ac67288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:58.828735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-445ca05e-6ca4-46ca-aaa1-90932ac67288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Jun 17 13:12:58.829288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 821/1736] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:58.943285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:58.943947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:58.951060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:58.951528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:58.952294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:58.952726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:59.017715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:59.027275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8acb116a-dac5-40f3-8941-a36cc99ac814 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089752 Jun 17 13:12:59.027887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 916/1737] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:59.173676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2028c489-dc0d-49c4-9b27-dabdd06c1605 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:59.174646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2028c489-dc0d-49c4-9b27-dabdd06c1605 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:59.181906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2028c489-dc0d-49c4-9b27-dabdd06c1605 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:59.182355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2028c489-dc0d-49c4-9b27-dabdd06c1605 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:59.183217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2028c489-dc0d-49c4-9b27-dabdd06c1605 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:59.183686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2028c489-dc0d-49c4-9b27-dabdd06c1605 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:59.216743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2028c489-dc0d-49c4-9b27-dabdd06c1605 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047162 Jun 17 13:12:59.217309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 822/1738] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:59 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:12:59.845716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2238e80f-be00-492d-8596-0b3edc8fd3e2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:59.847200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2238e80f-be00-492d-8596-0b3edc8fd3e2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:59.854389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2238e80f-be00-492d-8596-0b3edc8fd3e2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:59.854806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2238e80f-be00-492d-8596-0b3edc8fd3e2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:59.855600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2238e80f-be00-492d-8596-0b3edc8fd3e2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:59.856027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2238e80f-be00-492d-8596-0b3edc8fd3e2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:59.886208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2238e80f-be00-492d-8596-0b3edc8fd3e2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047633 Jun 17 13:12:59.886762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 917/1739] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:12:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:00.045453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:00.045986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:00.052229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:00.052916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:00.053541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:00.053970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:00.118522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:00.126925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0c3c622e-7cb5-4c56-9788-b3cd64f45209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085597 Jun 17 13:13:00.127536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 823/1740] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:00.229270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c549206-3cc3-48fe-8944-8373af23ff35 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:00.230189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c549206-3cc3-48fe-8944-8373af23ff35 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:00.233655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:00.237790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c549206-3cc3-48fe-8944-8373af23ff35 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:00.238264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c549206-3cc3-48fe-8944-8373af23ff35 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:00.239030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c549206-3cc3-48fe-8944-8373af23ff35 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:00.239512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c549206-3cc3-48fe-8944-8373af23ff35 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:00.272140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c549206-3cc3-48fe-8944-8373af23ff35 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047209 Jun 17 13:13:00.272712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 918/1741] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:00.902750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8b27e23e-466d-4ef1-8655-b75840d93b13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:00.903757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8b27e23e-466d-4ef1-8655-b75840d93b13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:00.911935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b27e23e-466d-4ef1-8655-b75840d93b13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:00.912492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b27e23e-466d-4ef1-8655-b75840d93b13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:00.913599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b27e23e-466d-4ef1-8655-b75840d93b13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:00.914121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b27e23e-466d-4ef1-8655-b75840d93b13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:00.947161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8b27e23e-466d-4ef1-8655-b75840d93b13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049774 Jun 17 13:13:00.947773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 824/1742] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:01.147718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:01.148516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:01.159017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:01.159737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:01.160992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:01.161706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:01.233510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:01.241762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-59358c0e-6abe-4b88-b342-ef9f210e4592 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100277 Jun 17 13:13:01.242327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 919/1743] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:01.287746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e7271bd8-f82e-4273-b311-efd9c17642f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:01.288820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e7271bd8-f82e-4273-b311-efd9c17642f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:01.295685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7271bd8-f82e-4273-b311-efd9c17642f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:01.296136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7271bd8-f82e-4273-b311-efd9c17642f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:01.296900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7271bd8-f82e-4273-b311-efd9c17642f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:01.297339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7271bd8-f82e-4273-b311-efd9c17642f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:01.334984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e7271bd8-f82e-4273-b311-efd9c17642f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054533 Jun 17 13:13:01.336496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 825/1744] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:01.962886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8b90aa43-95cd-482f-933e-fa9f783a5de2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:01.964412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8b90aa43-95cd-482f-933e-fa9f783a5de2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:01.974886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b90aa43-95cd-482f-933e-fa9f783a5de2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:01.975843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b90aa43-95cd-482f-933e-fa9f783a5de2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:01.976642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b90aa43-95cd-482f-933e-fa9f783a5de2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:01.977069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b90aa43-95cd-482f-933e-fa9f783a5de2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:02.008879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8b90aa43-95cd-482f-933e-fa9f783a5de2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052744 Jun 17 13:13:02.009364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 920/1745] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:02.262906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:02.263988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:02.275106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:02.275674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:02.276498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:02.277453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:02.340152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:02.346489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-266c1b41-2c86-41a0-80d4-75d9dc04f6f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:02.347360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-266c1b41-2c86-41a0-80d4-75d9dc04f6f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:02.348043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1b23cd7e-923f-46ec-bf28-66a7ac6ce076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092027 Jun 17 13:13:02.349006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 826/1746] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:02.354435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-266c1b41-2c86-41a0-80d4-75d9dc04f6f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:02.354886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-266c1b41-2c86-41a0-80d4-75d9dc04f6f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:02.355755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-266c1b41-2c86-41a0-80d4-75d9dc04f6f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:02.356189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-266c1b41-2c86-41a0-80d4-75d9dc04f6f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:02.386936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-266c1b41-2c86-41a0-80d4-75d9dc04f6f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Jun 17 13:13:02.387567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 921/1747] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:03.024989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3db225a2-ff42-4b0b-9224-510aee96c666 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:03.025918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3db225a2-ff42-4b0b-9224-510aee96c666 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:03.032392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3db225a2-ff42-4b0b-9224-510aee96c666 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:03.032860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3db225a2-ff42-4b0b-9224-510aee96c666 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:03.033583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3db225a2-ff42-4b0b-9224-510aee96c666 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:03.034007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3db225a2-ff42-4b0b-9224-510aee96c666 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:03.064636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3db225a2-ff42-4b0b-9224-510aee96c666 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Jun 17 13:13:03.065158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 827/1748] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:03.366333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:03.368574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:03.375675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:03.376110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:03.376857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:03.377280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:03.398533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-132a038b-acfd-4df1-83b9-63a30e327a89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:03.399579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-132a038b-acfd-4df1-83b9-63a30e327a89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:03.406334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-132a038b-acfd-4df1-83b9-63a30e327a89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:03.406792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-132a038b-acfd-4df1-83b9-63a30e327a89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:03.407580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-132a038b-acfd-4df1-83b9-63a30e327a89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:03.408032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-132a038b-acfd-4df1-83b9-63a30e327a89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:03.411718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:03.433815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=6 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:03.442066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-132a038b-acfd-4df1-83b9-63a30e327a89 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047594 Jun 17 13:13:03.442652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 828/1749] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:03.444274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:03.452455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-589a7acd-3f4a-45b4-b7c3-4a3b48cef790 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090093 Jun 17 13:13:03.453049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 922/1750] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:04.081274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0bdb28ad-f0f7-416f-a8f6-ed24a98b025c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:04.082655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0bdb28ad-f0f7-416f-a8f6-ed24a98b025c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:04.090959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bdb28ad-f0f7-416f-a8f6-ed24a98b025c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:04.091403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bdb28ad-f0f7-416f-a8f6-ed24a98b025c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:04.092196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bdb28ad-f0f7-416f-a8f6-ed24a98b025c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:04.092631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bdb28ad-f0f7-416f-a8f6-ed24a98b025c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:04.123644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0bdb28ad-f0f7-416f-a8f6-ed24a98b025c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049538 Jun 17 13:13:04.124209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 829/1751] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:04.455622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2f3a7a65-005e-48db-b5ae-235126c18faf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:04.456559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2f3a7a65-005e-48db-b5ae-235126c18faf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:04.465612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f3a7a65-005e-48db-b5ae-235126c18faf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:04.465612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f3a7a65-005e-48db-b5ae-235126c18faf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:04.466412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f3a7a65-005e-48db-b5ae-235126c18faf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:04.466849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f3a7a65-005e-48db-b5ae-235126c18faf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:04.471733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:04.472676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:04.480711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:04.481227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:04.482110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:04.483132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:04.500812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2f3a7a65-005e-48db-b5ae-235126c18faf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049251 Jun 17 13:13:04.501620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 923/1752] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:04.553949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:04.562063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a8af7b36-6a4d-4b07-a8d8-a62079ea2aaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094551 Jun 17 13:13:04.562610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 830/1753] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:05.137965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c7e58c0b-388e-430b-b121-7402426102a4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:05.138910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c7e58c0b-388e-430b-b121-7402426102a4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:05.145451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e58c0b-388e-430b-b121-7402426102a4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:05.145902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e58c0b-388e-430b-b121-7402426102a4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:05.146663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e58c0b-388e-430b-b121-7402426102a4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:05.147088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e58c0b-388e-430b-b121-7402426102a4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:05.177887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c7e58c0b-388e-430b-b121-7402426102a4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Jun 17 13:13:05.178438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 924/1754] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:05 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:05.517693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1d294be9-edf9-45f9-a00a-b7a2bb368fe3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:05.519303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1d294be9-edf9-45f9-a00a-b7a2bb368fe3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:05.530929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d294be9-edf9-45f9-a00a-b7a2bb368fe3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:05.531579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d294be9-edf9-45f9-a00a-b7a2bb368fe3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:05.532398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d294be9-edf9-45f9-a00a-b7a2bb368fe3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:05.532875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d294be9-edf9-45f9-a00a-b7a2bb368fe3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:05.562903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1d294be9-edf9-45f9-a00a-b7a2bb368fe3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052313 Jun 17 13:13:05.563477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 831/1755] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:05.582217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:05.582860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:05.591875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:05.592353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:05.593107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:05.593543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:05.665048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:05.673463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7da288d2-53a2-4c55-93c6-3a410e40d179 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097377 Jun 17 13:13:05.674037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 925/1756] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:06.193255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed96d341-8813-4780-88bc-6ca98f09659b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:06.194546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed96d341-8813-4780-88bc-6ca98f09659b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:06.205017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed96d341-8813-4780-88bc-6ca98f09659b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:06.205769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed96d341-8813-4780-88bc-6ca98f09659b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:06.207056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed96d341-8813-4780-88bc-6ca98f09659b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:06.208450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed96d341-8813-4780-88bc-6ca98f09659b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:06.247122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed96d341-8813-4780-88bc-6ca98f09659b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059379 Jun 17 13:13:06.247718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 832/1757] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:06 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:06.577478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ce5ac4c7-e5df-4b04-a920-dfeabf8aae18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:06.578406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ce5ac4c7-e5df-4b04-a920-dfeabf8aae18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:06.585018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce5ac4c7-e5df-4b04-a920-dfeabf8aae18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:06.585647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce5ac4c7-e5df-4b04-a920-dfeabf8aae18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:06.586216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce5ac4c7-e5df-4b04-a920-dfeabf8aae18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:06.586636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce5ac4c7-e5df-4b04-a920-dfeabf8aae18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:06.618826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ce5ac4c7-e5df-4b04-a920-dfeabf8aae18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Jun 17 13:13:06.619353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 926/1758] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:06.690335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:06.690952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:06.694394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:06.698926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:06.699393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:06.700179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:06.700611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:06.770767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:06.778715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a0b3efe-c6f5-41f3-9842-7aeff450ad3b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092456 Jun 17 13:13:06.779281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 833/1759] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:07.266238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8987eb0c-1c05-449d-9284-d71be2d372c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:07.267781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8987eb0c-1c05-449d-9284-d71be2d372c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:07.277493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8987eb0c-1c05-449d-9284-d71be2d372c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:07.277941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8987eb0c-1c05-449d-9284-d71be2d372c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:07.278709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8987eb0c-1c05-449d-9284-d71be2d372c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:07.279142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8987eb0c-1c05-449d-9284-d71be2d372c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:07.313538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8987eb0c-1c05-449d-9284-d71be2d372c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054633 Jun 17 13:13:07.314101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 927/1760] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:07 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:07.634900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4dff15a7-3ef5-429e-8220-c78b61ddff5b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:07.636257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4dff15a7-3ef5-429e-8220-c78b61ddff5b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:07.642945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dff15a7-3ef5-429e-8220-c78b61ddff5b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:07.643396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dff15a7-3ef5-429e-8220-c78b61ddff5b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:07.644172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dff15a7-3ef5-429e-8220-c78b61ddff5b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:07.644599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dff15a7-3ef5-429e-8220-c78b61ddff5b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:07.676598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4dff15a7-3ef5-429e-8220-c78b61ddff5b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048501 Jun 17 13:13:07.677141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 834/1761] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:07 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:07.796001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:07.796645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:07.803773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:07.804244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:07.805043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:07.805502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:07.869994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:07.876600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:07.881950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c955935-c92a-4d69-8bd0-18c9c221b09c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090431 Jun 17 13:13:07.882535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 928/1762] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:08.328041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a5cb93e2-231c-45a4-8ede-1d868bdefafc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:08.329001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a5cb93e2-231c-45a4-8ede-1d868bdefafc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:08.336250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5cb93e2-231c-45a4-8ede-1d868bdefafc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:08.336699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5cb93e2-231c-45a4-8ede-1d868bdefafc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:08.337464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5cb93e2-231c-45a4-8ede-1d868bdefafc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:08.337898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a5cb93e2-231c-45a4-8ede-1d868bdefafc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:08.369408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a5cb93e2-231c-45a4-8ede-1d868bdefafc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Jun 17 13:13:08.369906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 835/1763] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:08 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:08.693243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a405c4c-f948-465b-9c51-35071af82e79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:08.694588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0a405c4c-f948-465b-9c51-35071af82e79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:08.705882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a405c4c-f948-465b-9c51-35071af82e79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:08.706695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a405c4c-f948-465b-9c51-35071af82e79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:08.708195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a405c4c-f948-465b-9c51-35071af82e79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:08.708995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a405c4c-f948-465b-9c51-35071af82e79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:08.743987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0a405c4c-f948-465b-9c51-35071af82e79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057350 Jun 17 13:13:08.744767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 929/1764] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:08.902040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:08.902918 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:08.912362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:08.912945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:08.913939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:08.914511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:08.920126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:08.991944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:09.001676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1e783b5-3a06-4005-b6d1-f0345d9c89c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.104917 Jun 17 13:13:09.002259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 836/1765] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:09.383678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ad064410-0cba-4356-9575-fc2004e2c03a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:09.384592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ad064410-0cba-4356-9575-fc2004e2c03a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:09.391586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad064410-0cba-4356-9575-fc2004e2c03a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:09.392042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad064410-0cba-4356-9575-fc2004e2c03a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:09.392796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad064410-0cba-4356-9575-fc2004e2c03a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:09.393234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad064410-0cba-4356-9575-fc2004e2c03a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:09.427908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ad064410-0cba-4356-9575-fc2004e2c03a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048618 Jun 17 13:13:09.428473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 930/1766] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:09 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:09.766564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d7a8e6ba-91d8-46b5-98f4-ff02dc293301 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:09.767527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d7a8e6ba-91d8-46b5-98f4-ff02dc293301 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:09.774573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a8e6ba-91d8-46b5-98f4-ff02dc293301 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:09.775019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a8e6ba-91d8-46b5-98f4-ff02dc293301 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:09.775819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a8e6ba-91d8-46b5-98f4-ff02dc293301 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:09.776247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7a8e6ba-91d8-46b5-98f4-ff02dc293301 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:09.808600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d7a8e6ba-91d8-46b5-98f4-ff02dc293301 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053066 Jun 17 13:13:09.809161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 837/1767] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:10.027172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:10.028088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:10.036431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:10.036881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:10.037651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:10.038085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:10.101113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:10.109514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-85d42114-4630-4888-a5ee-1eff0ee72d2a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088481 Jun 17 13:13:10.110126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 931/1768] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:10 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:10.440127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7d5bed06-0072-412f-8251-7a7733f353ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:10.440982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7d5bed06-0072-412f-8251-7a7733f353ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:10.447629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d5bed06-0072-412f-8251-7a7733f353ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:10.448079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d5bed06-0072-412f-8251-7a7733f353ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:10.448844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d5bed06-0072-412f-8251-7a7733f353ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:10.449248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d5bed06-0072-412f-8251-7a7733f353ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:10.479148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7d5bed06-0072-412f-8251-7a7733f353ae tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jun 17 13:13:10.479731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 838/1769] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:10 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:10.823143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6d4faec5-d608-4302-82dd-52d6c5f497cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:10.824460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6d4faec5-d608-4302-82dd-52d6c5f497cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:10.834323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d4faec5-d608-4302-82dd-52d6c5f497cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:10.834987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d4faec5-d608-4302-82dd-52d6c5f497cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:10.836060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d4faec5-d608-4302-82dd-52d6c5f497cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:10.836727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d4faec5-d608-4302-82dd-52d6c5f497cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:10.869309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6d4faec5-d608-4302-82dd-52d6c5f497cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051478 Jun 17 13:13:10.869858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 932/1770] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:11.131581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:11.132622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:11.142928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:11.143396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:11.144184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:11.144603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:11.207273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:11.221610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a49cca6f-79f2-4a41-a266-7c04ccba238a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096736 Jun 17 13:13:11.222416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 839/1771] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:11.492262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f100bf3c-cc56-424c-9d39-211621884109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:11.493403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f100bf3c-cc56-424c-9d39-211621884109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:11.501422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f100bf3c-cc56-424c-9d39-211621884109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:11.501874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f100bf3c-cc56-424c-9d39-211621884109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:11.502623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f100bf3c-cc56-424c-9d39-211621884109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:11.503074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f100bf3c-cc56-424c-9d39-211621884109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:11.533353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f100bf3c-cc56-424c-9d39-211621884109 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046152 Jun 17 13:13:11.533921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 933/1772] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:11 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:11.886215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a7f77001-ccb7-4f88-892b-3c22c4f8150e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:11.887764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a7f77001-ccb7-4f88-892b-3c22c4f8150e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:11.895837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f77001-ccb7-4f88-892b-3c22c4f8150e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:11.896285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f77001-ccb7-4f88-892b-3c22c4f8150e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:11.897049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f77001-ccb7-4f88-892b-3c22c4f8150e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:11.897482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f77001-ccb7-4f88-892b-3c22c4f8150e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:11.927119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a7f77001-ccb7-4f88-892b-3c22c4f8150e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048007 Jun 17 13:13:11.927712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 840/1773] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:12.243635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:12.244198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:12.251784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:12.252580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:12.253356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:12.253783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:12.320662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:12.332668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7f5f79b2-fd0e-417b-9454-4942d77fdb0a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092775 Jun 17 13:13:12.333397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 934/1774] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:12.547584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d680a496-1fb7-42ad-967e-24066629a2c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:12.548556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d680a496-1fb7-42ad-967e-24066629a2c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:12.555779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d680a496-1fb7-42ad-967e-24066629a2c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:12.556254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d680a496-1fb7-42ad-967e-24066629a2c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:12.556998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d680a496-1fb7-42ad-967e-24066629a2c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:12.557433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d680a496-1fb7-42ad-967e-24066629a2c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:12.587723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d680a496-1fb7-42ad-967e-24066629a2c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Jun 17 13:13:12.588285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 841/1775] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:12 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:12.941996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bcd9fedf-3561-4f05-813e-315f597fa9d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:12.942973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bcd9fedf-3561-4f05-813e-315f597fa9d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:12.949851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bcd9fedf-3561-4f05-813e-315f597fa9d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:12.950327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bcd9fedf-3561-4f05-813e-315f597fa9d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:12.951123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bcd9fedf-3561-4f05-813e-315f597fa9d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:12.951621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bcd9fedf-3561-4f05-813e-315f597fa9d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:12.981972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bcd9fedf-3561-4f05-813e-315f597fa9d2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045472 Jun 17 13:13:12.982528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 935/1776] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:13.357121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:13.358256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:13.366230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:13.366676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:13.367469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:13.367907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:13.446716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:13.454854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8b723d3f-1e96-43ec-8acd-43fef04a4c6f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.104254 Jun 17 13:13:13.455553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 842/1777] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:13.604723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9d2fc06-13bb-4ef4-9c1a-97494c50b252 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:13.606283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9d2fc06-13bb-4ef4-9c1a-97494c50b252 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:13.624242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d2fc06-13bb-4ef4-9c1a-97494c50b252 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:13.624854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d2fc06-13bb-4ef4-9c1a-97494c50b252 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:13.626094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d2fc06-13bb-4ef4-9c1a-97494c50b252 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:13.626806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9d2fc06-13bb-4ef4-9c1a-97494c50b252 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:13.662722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9d2fc06-13bb-4ef4-9c1a-97494c50b252 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064216 Jun 17 13:13:13.663707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 936/1778] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:13.993707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1139efc2-0ed2-4829-af7c-997572a22439 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:13.994645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1139efc2-0ed2-4829-af7c-997572a22439 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:14.001833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1139efc2-0ed2-4829-af7c-997572a22439 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:14.002761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1139efc2-0ed2-4829-af7c-997572a22439 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:14.003557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1139efc2-0ed2-4829-af7c-997572a22439 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:14.003991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1139efc2-0ed2-4829-af7c-997572a22439 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:14.035096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1139efc2-0ed2-4829-af7c-997572a22439 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Jun 17 13:13:14.035674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 843/1779] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:14.473469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:14.474010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:14.480933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:14.481425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:14.482269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:14.482703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:14.557043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:14.567468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b9ac852-fbff-4c22-adb6-98980516e4fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098209 Jun 17 13:13:14.568166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 937/1780] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:14.679157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad2e4b74-f192-4c06-8ecc-16751a29fcce tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:14.680175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad2e4b74-f192-4c06-8ecc-16751a29fcce tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:14.687011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2e4b74-f192-4c06-8ecc-16751a29fcce tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:14.687506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2e4b74-f192-4c06-8ecc-16751a29fcce tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:14.688276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2e4b74-f192-4c06-8ecc-16751a29fcce tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:14.688706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad2e4b74-f192-4c06-8ecc-16751a29fcce tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:14.724621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad2e4b74-f192-4c06-8ecc-16751a29fcce tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050057 Jun 17 13:13:14.725089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 844/1781] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:14 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:15.049677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f8977f5b-1e21-4c0a-8bc5-70e658103252 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:15.050819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f8977f5b-1e21-4c0a-8bc5-70e658103252 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:15.061524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8977f5b-1e21-4c0a-8bc5-70e658103252 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:15.062066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8977f5b-1e21-4c0a-8bc5-70e658103252 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:15.062998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8977f5b-1e21-4c0a-8bc5-70e658103252 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:15.063575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f8977f5b-1e21-4c0a-8bc5-70e658103252 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:15.095973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f8977f5b-1e21-4c0a-8bc5-70e658103252 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053014 Jun 17 13:13:15.096782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 938/1782] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:15.585000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:15.585626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:15.592663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:15.593114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:15.593870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:15.594302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:15.659023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:15.667155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6ce603c2-ff70-470f-a51a-79baef09c484 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086181 Jun 17 13:13:15.667761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 845/1783] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:15.740916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-155ea5ee-be40-4cb8-a529-35d618bf1fd0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:15.742412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-155ea5ee-be40-4cb8-a529-35d618bf1fd0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:15.752848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-155ea5ee-be40-4cb8-a529-35d618bf1fd0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:15.753296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-155ea5ee-be40-4cb8-a529-35d618bf1fd0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:15.754065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-155ea5ee-be40-4cb8-a529-35d618bf1fd0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:15.754862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-155ea5ee-be40-4cb8-a529-35d618bf1fd0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:15.786704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-155ea5ee-be40-4cb8-a529-35d618bf1fd0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052734 Jun 17 13:13:15.787270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 939/1784] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:15 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:16.113012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-884ae1a2-5560-4a45-9b99-d7d4bc057331 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:16.113959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-884ae1a2-5560-4a45-9b99-d7d4bc057331 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:16.120639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-884ae1a2-5560-4a45-9b99-d7d4bc057331 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:16.121087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-884ae1a2-5560-4a45-9b99-d7d4bc057331 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:16.121895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-884ae1a2-5560-4a45-9b99-d7d4bc057331 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:16.122324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-884ae1a2-5560-4a45-9b99-d7d4bc057331 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:16.153052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-884ae1a2-5560-4a45-9b99-d7d4bc057331 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046507 Jun 17 13:13:16.153599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 846/1785] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:16.686786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:16.687625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:16.695347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:16.695823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:16.696585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:16.697012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:16.769705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:16.778871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d480ae35-67c9-48d6-a77e-38448fe21115 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097203 Jun 17 13:13:16.779692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 940/1786] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:16.798375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-77424d5c-cb9d-4688-ad72-ed8b9892a8c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:16.799291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-77424d5c-cb9d-4688-ad72-ed8b9892a8c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:16.807728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77424d5c-cb9d-4688-ad72-ed8b9892a8c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:16.808175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77424d5c-cb9d-4688-ad72-ed8b9892a8c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:16.808945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77424d5c-cb9d-4688-ad72-ed8b9892a8c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:16.809379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77424d5c-cb9d-4688-ad72-ed8b9892a8c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:16.838899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-77424d5c-cb9d-4688-ad72-ed8b9892a8c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Jun 17 13:13:16.839457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 847/1787] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:16 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:13:17.165487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-348151c8-2ce0-4f16-adcb-9501a004c79a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:17.166426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-348151c8-2ce0-4f16-adcb-9501a004c79a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:17.172942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-348151c8-2ce0-4f16-adcb-9501a004c79a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:17.173369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-348151c8-2ce0-4f16-adcb-9501a004c79a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:17.174146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-348151c8-2ce0-4f16-adcb-9501a004c79a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:17.174574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-348151c8-2ce0-4f16-adcb-9501a004c79a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:17.204654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-348151c8-2ce0-4f16-adcb-9501a004c79a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043311 Jun 17 13:13:17.205207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 941/1788] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:17.800769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:17.801347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:17.808404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:17.808843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:17.809610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:17.810040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:17.853130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aae02abd-f0d1-4343-a7e1-2b274b599965 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:17.854764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aae02abd-f0d1-4343-a7e1-2b274b599965 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:17.864842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aae02abd-f0d1-4343-a7e1-2b274b599965 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:17.865304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aae02abd-f0d1-4343-a7e1-2b274b599965 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:17.866061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aae02abd-f0d1-4343-a7e1-2b274b599965 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:17.866498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aae02abd-f0d1-4343-a7e1-2b274b599965 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:17.880804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:17.889281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1e97b08a-9ff6-448d-8839-c0e686dfbe48 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094225 Jun 17 13:13:17.889861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 848/1789] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:17.897563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aae02abd-f0d1-4343-a7e1-2b274b599965 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050738 Jun 17 13:13:17.898858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 942/1790] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:18.220979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5ecdea35-956e-4b7c-83f9-39fe8d440f1c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:18.222291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5ecdea35-956e-4b7c-83f9-39fe8d440f1c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:18.229093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ecdea35-956e-4b7c-83f9-39fe8d440f1c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:18.229551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ecdea35-956e-4b7c-83f9-39fe8d440f1c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:18.230306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ecdea35-956e-4b7c-83f9-39fe8d440f1c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:18.230732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ecdea35-956e-4b7c-83f9-39fe8d440f1c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:18.261545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5ecdea35-956e-4b7c-83f9-39fe8d440f1c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Jun 17 13:13:18.262105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 849/1791] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:18.909825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:18.910640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:18.911308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1dc57c7-a18f-437d-b428-d3f6abd2b785 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:18.912254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1dc57c7-a18f-437d-b428-d3f6abd2b785 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:18.918633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:18.918834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:18.918946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1dc57c7-a18f-437d-b428-d3f6abd2b785 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:18.919422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1dc57c7-a18f-437d-b428-d3f6abd2b785 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:18.919629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:18.920091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:18.920285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1dc57c7-a18f-437d-b428-d3f6abd2b785 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:18.920633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1dc57c7-a18f-437d-b428-d3f6abd2b785 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:18.950531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1dc57c7-a18f-437d-b428-d3f6abd2b785 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Jun 17 13:13:18.951089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 850/1792] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:18 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:18.983321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:18.991362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1ac4790f-8332-4b30-8956-a06d5f092106 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087249 Jun 17 13:13:18.991947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 943/1793] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:19.273567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0700b7e1-50b3-4c30-acbd-f4ce0804b57e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:19.274560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0700b7e1-50b3-4c30-acbd-f4ce0804b57e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:19.281437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0700b7e1-50b3-4c30-acbd-f4ce0804b57e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:19.282030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0700b7e1-50b3-4c30-acbd-f4ce0804b57e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:19.282800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0700b7e1-50b3-4c30-acbd-f4ce0804b57e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:19.283235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0700b7e1-50b3-4c30-acbd-f4ce0804b57e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:19.312993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0700b7e1-50b3-4c30-acbd-f4ce0804b57e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Jun 17 13:13:19.313540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 851/1794] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:19.965866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76c6874a-ebc3-4367-b37b-3e4b0d14ee03 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:19.967259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76c6874a-ebc3-4367-b37b-3e4b0d14ee03 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:19.977293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76c6874a-ebc3-4367-b37b-3e4b0d14ee03 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:19.977966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76c6874a-ebc3-4367-b37b-3e4b0d14ee03 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:19.979056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76c6874a-ebc3-4367-b37b-3e4b0d14ee03 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:19.979722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76c6874a-ebc3-4367-b37b-3e4b0d14ee03 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:20.008630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:20.009920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:20.015909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76c6874a-ebc3-4367-b37b-3e4b0d14ee03 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056423 Jun 17 13:13:20.016414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 944/1795] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:19 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:20.016674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:20.017095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:20.017851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:20.018278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:20.092678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:20.096130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:20.102529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a914565c-226d-466e-8b4d-47ca7e5cf0b2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097236 Jun 17 13:13:20.102529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 852/1796] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:20 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:20.332217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-098e5065-e675-4814-b321-5b8b2985ac18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:20.333770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-098e5065-e675-4814-b321-5b8b2985ac18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:20.344488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-098e5065-e675-4814-b321-5b8b2985ac18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:20.345335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-098e5065-e675-4814-b321-5b8b2985ac18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:20.346701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-098e5065-e675-4814-b321-5b8b2985ac18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:20.347455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-098e5065-e675-4814-b321-5b8b2985ac18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:20.365096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:20.379588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-098e5065-e675-4814-b321-5b8b2985ac18 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053923 Jun 17 13:13:20.380175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 945/1797] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:21.033185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d4aab091-eb28-47d0-988f-72c11ee61906 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:21.034839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d4aab091-eb28-47d0-988f-72c11ee61906 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:21.043108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4aab091-eb28-47d0-988f-72c11ee61906 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:21.043584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4aab091-eb28-47d0-988f-72c11ee61906 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:21.044342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4aab091-eb28-47d0-988f-72c11ee61906 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:21.044770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4aab091-eb28-47d0-988f-72c11ee61906 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:21.074788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d4aab091-eb28-47d0-988f-72c11ee61906 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049039 Jun 17 13:13:21.075325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 853/1798] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:21.118326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:21.118908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:21.125899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:21.126339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:21.127096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:21.127565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:21.195931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:21.208800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5697c4c7-9d9e-4177-baf2-2cc59759a416 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093444 Jun 17 13:13:21.209734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 946/1799] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:21 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:21.395584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc71d36d-2cda-4cdc-83ab-b598874e5bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:21.397079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc71d36d-2cda-4cdc-83ab-b598874e5bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:21.406723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc71d36d-2cda-4cdc-83ab-b598874e5bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:21.407295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc71d36d-2cda-4cdc-83ab-b598874e5bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:21.408418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc71d36d-2cda-4cdc-83ab-b598874e5bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:21.408962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc71d36d-2cda-4cdc-83ab-b598874e5bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:21.446021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc71d36d-2cda-4cdc-83ab-b598874e5bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057436 Jun 17 13:13:21.446582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 854/1800] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:22.088657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-03ffb33c-6c2a-41ed-8773-10c8703274e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:22.089493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-03ffb33c-6c2a-41ed-8773-10c8703274e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:22.096074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ffb33c-6c2a-41ed-8773-10c8703274e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:22.096515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ffb33c-6c2a-41ed-8773-10c8703274e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:22.097271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ffb33c-6c2a-41ed-8773-10c8703274e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:22.097702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-03ffb33c-6c2a-41ed-8773-10c8703274e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:22.129572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-03ffb33c-6c2a-41ed-8773-10c8703274e3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Jun 17 13:13:22.130218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 947/1801] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:22 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:22.228852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:22.229478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:22.238766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:22.239319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:22.240530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:22.241253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:22.317938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:22.326221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f9e99c78-582d-40a8-8b25-eb838eb8867b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.103429 Jun 17 13:13:22.326778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 855/1802] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:22.462828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4c4bf2c2-32ab-43fb-8e5f-4e66c5646d12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:22.464253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4c4bf2c2-32ab-43fb-8e5f-4e66c5646d12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:22.474521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4c4bf2c2-32ab-43fb-8e5f-4e66c5646d12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:22.475305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4c4bf2c2-32ab-43fb-8e5f-4e66c5646d12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:22.476379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4c4bf2c2-32ab-43fb-8e5f-4e66c5646d12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:22.476574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4c4bf2c2-32ab-43fb-8e5f-4e66c5646d12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:22.510844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4c4bf2c2-32ab-43fb-8e5f-4e66c5646d12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055032 Jun 17 13:13:22.511410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 948/1803] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:23.145356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ce627d2a-eafe-4834-99cc-e77de7a189e1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:23.146680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ce627d2a-eafe-4834-99cc-e77de7a189e1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:23.156616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ce627d2a-eafe-4834-99cc-e77de7a189e1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:23.157282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ce627d2a-eafe-4834-99cc-e77de7a189e1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:23.158362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ce627d2a-eafe-4834-99cc-e77de7a189e1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:23.158812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ce627d2a-eafe-4834-99cc-e77de7a189e1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:23.190053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ce627d2a-eafe-4834-99cc-e77de7a189e1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051317 Jun 17 13:13:23.190600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 856/1804] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:23 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:23.348742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:23.350736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:23.358069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:23.358513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:23.359272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:23.359743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:23.432419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:23.444080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49492d8b-dfdd-4eeb-b080-59df503ac18a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.102187 Jun 17 13:13:23.444830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 949/1805] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:23.523105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5b37951c-0828-4bf8-aad8-8d64ff399ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:23.524059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5b37951c-0828-4bf8-aad8-8d64ff399ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:23.531615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b37951c-0828-4bf8-aad8-8d64ff399ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:23.532237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b37951c-0828-4bf8-aad8-8d64ff399ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:23.533206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b37951c-0828-4bf8-aad8-8d64ff399ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:23.533653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b37951c-0828-4bf8-aad8-8d64ff399ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:23.565279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5b37951c-0828-4bf8-aad8-8d64ff399ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Jun 17 13:13:23.565843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 857/1806] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:24.202838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-112dc7d5-7297-402e-bdb0-3d53026b391f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:24.203829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-112dc7d5-7297-402e-bdb0-3d53026b391f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:24.210727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-112dc7d5-7297-402e-bdb0-3d53026b391f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:24.211159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-112dc7d5-7297-402e-bdb0-3d53026b391f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:24.211950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-112dc7d5-7297-402e-bdb0-3d53026b391f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:24.212458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-112dc7d5-7297-402e-bdb0-3d53026b391f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:24.242332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-112dc7d5-7297-402e-bdb0-3d53026b391f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Jun 17 13:13:24.242899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 950/1807] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:24.465022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:24.465534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:24.471943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:24.472388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:24.473143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:24.473574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:24.535709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:24.545684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1af0902-5ed2-4709-8162-eb0a60fb8b57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085796 Jun 17 13:13:24.546461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 858/1808] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:24.578784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f7ef2160-0fa9-43c9-9f53-6b24fc4fdeba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:24.579729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f7ef2160-0fa9-43c9-9f53-6b24fc4fdeba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:24.586890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7ef2160-0fa9-43c9-9f53-6b24fc4fdeba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:24.587341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7ef2160-0fa9-43c9-9f53-6b24fc4fdeba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:24.588144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7ef2160-0fa9-43c9-9f53-6b24fc4fdeba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:24.588577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7ef2160-0fa9-43c9-9f53-6b24fc4fdeba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:24.618287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f7ef2160-0fa9-43c9-9f53-6b24fc4fdeba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Jun 17 13:13:24.618854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 951/1809] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:25.255111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8050c37b-a610-47cb-8a58-3f67997721ac tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:25.256156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8050c37b-a610-47cb-8a58-3f67997721ac tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:25.263252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8050c37b-a610-47cb-8a58-3f67997721ac tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:25.263913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8050c37b-a610-47cb-8a58-3f67997721ac tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:25.265112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8050c37b-a610-47cb-8a58-3f67997721ac tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:25.265780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8050c37b-a610-47cb-8a58-3f67997721ac tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:25.299129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8050c37b-a610-47cb-8a58-3f67997721ac tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049408 Jun 17 13:13:25.299719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 859/1810] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:25 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:25.562620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:25.563195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:25.569773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:25.570218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:25.570970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:25.571400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:25.632725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e66dfe71-c387-4bb7-b472-333094514307 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:25.633748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e66dfe71-c387-4bb7-b472-333094514307 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:25.641147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e66dfe71-c387-4bb7-b472-333094514307 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:25.641722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e66dfe71-c387-4bb7-b472-333094514307 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:25.642569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e66dfe71-c387-4bb7-b472-333094514307 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:25.642916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:25.643390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e66dfe71-c387-4bb7-b472-333094514307 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:25.650793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aedb1923-fc60-45c9-9a32-2cae607b3261 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092075 Jun 17 13:13:25.651354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 952/1811] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:25.674167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e66dfe71-c387-4bb7-b472-333094514307 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045957 Jun 17 13:13:25.674723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 860/1812] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:25 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:26.315737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef34fbbe-2d0d-4b1f-8f26-817ff99423f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:26.317028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef34fbbe-2d0d-4b1f-8f26-817ff99423f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:26.325286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef34fbbe-2d0d-4b1f-8f26-817ff99423f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:26.325721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef34fbbe-2d0d-4b1f-8f26-817ff99423f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:26.326473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef34fbbe-2d0d-4b1f-8f26-817ff99423f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:26.326895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef34fbbe-2d0d-4b1f-8f26-817ff99423f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:26.357086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef34fbbe-2d0d-4b1f-8f26-817ff99423f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Jun 17 13:13:26.357633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 953/1813] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:26.669172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:26.669781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:26.676400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:26.676840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:26.677597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:26.678024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:26.686686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-52423dee-247a-41bb-80cd-64386a8ffaa8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:26.687723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-52423dee-247a-41bb-80cd-64386a8ffaa8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:26.694523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52423dee-247a-41bb-80cd-64386a8ffaa8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:26.694961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52423dee-247a-41bb-80cd-64386a8ffaa8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:26.695775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52423dee-247a-41bb-80cd-64386a8ffaa8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:26.696195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52423dee-247a-41bb-80cd-64386a8ffaa8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:26.727747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-52423dee-247a-41bb-80cd-64386a8ffaa8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Jun 17 13:13:26.731884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 954/1814] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:26.743066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:26.751016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed81fe4b-ced8-4bae-8bcb-b8b65bc80840 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085999 Jun 17 13:13:26.751590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 861/1815] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:27.283632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:13:27.283904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:13:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:13:27.368979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-beb7b207-591c-490a-b0f3-900051b73b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:27.369831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-beb7b207-591c-490a-b0f3-900051b73b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:27.376450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beb7b207-591c-490a-b0f3-900051b73b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:27.376885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beb7b207-591c-490a-b0f3-900051b73b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:27.377631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beb7b207-591c-490a-b0f3-900051b73b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:27.378054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beb7b207-591c-490a-b0f3-900051b73b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:27.408711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-beb7b207-591c-490a-b0f3-900051b73b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Jun 17 13:13:27.409262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 955/1816] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:27.744087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ae737b13-d362-486b-aa73-659a52e5c49c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:27.745653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ae737b13-d362-486b-aa73-659a52e5c49c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:27.757121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae737b13-d362-486b-aa73-659a52e5c49c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:27.757862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae737b13-d362-486b-aa73-659a52e5c49c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:27.759121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae737b13-d362-486b-aa73-659a52e5c49c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:27.759915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae737b13-d362-486b-aa73-659a52e5c49c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:27.768656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:27.769050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:27.777109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:27.777560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:27.778320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:27.778778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:27.791087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ae737b13-d362-486b-aa73-659a52e5c49c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053689 Jun 17 13:13:27.791722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 862/1817] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:27.842211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:27.853638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a1299cc1-7207-4007-bf16-e48e7a12cd0c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088707 Jun 17 13:13:27.854177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 956/1818] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:28.423277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ddbc6e19-a8f9-4a5c-b95d-16eaafc9cb9f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:28.424346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ddbc6e19-a8f9-4a5c-b95d-16eaafc9cb9f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:28.432367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e19-a8f9-4a5c-b95d-16eaafc9cb9f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:28.432929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e19-a8f9-4a5c-b95d-16eaafc9cb9f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:28.433912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e19-a8f9-4a5c-b95d-16eaafc9cb9f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:28.434457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddbc6e19-a8f9-4a5c-b95d-16eaafc9cb9f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:28.467008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ddbc6e19-a8f9-4a5c-b95d-16eaafc9cb9f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049551 Jun 17 13:13:28.467600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 863/1819] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:28.804847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2635162-3ce6-4775-bb01-6c701164006d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:28.805986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2635162-3ce6-4775-bb01-6c701164006d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:28.815411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2635162-3ce6-4775-bb01-6c701164006d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:28.815864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2635162-3ce6-4775-bb01-6c701164006d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:28.816929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2635162-3ce6-4775-bb01-6c701164006d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:28.817538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2635162-3ce6-4775-bb01-6c701164006d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:28.864783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2635162-3ce6-4775-bb01-6c701164006d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064660 Jun 17 13:13:28.865486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 957/1820] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:28.873338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:28.873940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:28.880519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:28.880950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:28.881701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:28.882125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:28.947878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:28.956748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-97226e02-ae05-4596-ae5b-3e63b1ca9d8f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089090 Jun 17 13:13:28.957317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 864/1821] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:29.479511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6e5e07de-836d-4c15-9198-5271320a2404 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:29.480336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6e5e07de-836d-4c15-9198-5271320a2404 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:29.487747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e5e07de-836d-4c15-9198-5271320a2404 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:29.488329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e5e07de-836d-4c15-9198-5271320a2404 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:29.489119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e5e07de-836d-4c15-9198-5271320a2404 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:29.489544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e5e07de-836d-4c15-9198-5271320a2404 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:29.522257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6e5e07de-836d-4c15-9198-5271320a2404 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046957 Jun 17 13:13:29.522816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 958/1822] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:29 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:29.880987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a55ad2b7-ab76-4b48-9f67-7b6934613640 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:29.882267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a55ad2b7-ab76-4b48-9f67-7b6934613640 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:29.891536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ad2b7-ab76-4b48-9f67-7b6934613640 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:29.891988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ad2b7-ab76-4b48-9f67-7b6934613640 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:29.892746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ad2b7-ab76-4b48-9f67-7b6934613640 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:29.893171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ad2b7-ab76-4b48-9f67-7b6934613640 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:29.922612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a55ad2b7-ab76-4b48-9f67-7b6934613640 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048890 Jun 17 13:13:29.923156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 865/1823] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:29.974392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:29.974956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:29.982668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:29.983102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:29.983957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:29.984408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:30.056254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:30.067501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-63572a8b-e47a-4521-b75d-a5c9f561a8ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096961 Jun 17 13:13:30.068055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 959/1824] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:30.537885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b17cdfe2-3790-43be-a74f-53ce36841260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:30.539316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b17cdfe2-3790-43be-a74f-53ce36841260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:30.547893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b17cdfe2-3790-43be-a74f-53ce36841260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:30.548336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b17cdfe2-3790-43be-a74f-53ce36841260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:30.549098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b17cdfe2-3790-43be-a74f-53ce36841260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:30.549521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b17cdfe2-3790-43be-a74f-53ce36841260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:30.580680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b17cdfe2-3790-43be-a74f-53ce36841260 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048867 Jun 17 13:13:30.581267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 866/1825] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:30 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:30.937834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-274162cd-61cc-4d19-9754-f183c51691c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:30.938802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-274162cd-61cc-4d19-9754-f183c51691c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:30.940815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=83 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:30.946708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-274162cd-61cc-4d19-9754-f183c51691c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:30.947164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-274162cd-61cc-4d19-9754-f183c51691c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:30.947980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-274162cd-61cc-4d19-9754-f183c51691c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:30.948427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-274162cd-61cc-4d19-9754-f183c51691c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:30.978808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-274162cd-61cc-4d19-9754-f183c51691c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046694 Jun 17 13:13:30.979460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 960/1826] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:30 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:31.089292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:31.090192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:31.098149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:31.098616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:31.099414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:31.099851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:31.175613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:31.189318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-825f36d1-506a-4a85-b387-e41120ae207e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.106465 Jun 17 13:13:31.190190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 867/1827] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:31.594082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a78a3e39-0510-4626-8dfe-d201c4cf902a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:31.595010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a78a3e39-0510-4626-8dfe-d201c4cf902a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:31.601981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a78a3e39-0510-4626-8dfe-d201c4cf902a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:31.602422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a78a3e39-0510-4626-8dfe-d201c4cf902a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:31.603180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a78a3e39-0510-4626-8dfe-d201c4cf902a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:31.603643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a78a3e39-0510-4626-8dfe-d201c4cf902a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:31.634485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a78a3e39-0510-4626-8dfe-d201c4cf902a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Jun 17 13:13:31.635049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 961/1828] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:31.993476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-123afb59-8ffc-43e6-8177-746cf8093205 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:31.994908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-123afb59-8ffc-43e6-8177-746cf8093205 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:32.005715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-123afb59-8ffc-43e6-8177-746cf8093205 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:32.006450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-123afb59-8ffc-43e6-8177-746cf8093205 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:32.007784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-123afb59-8ffc-43e6-8177-746cf8093205 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:32.008483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-123afb59-8ffc-43e6-8177-746cf8093205 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:32.040666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-123afb59-8ffc-43e6-8177-746cf8093205 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053275 Jun 17 13:13:32.041212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 868/1829] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:32.215798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:32.216385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:32.226253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:32.226899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:32.228058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:32.228681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:32.234469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:32.294367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:32.302502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f5fe6dd6-7821-4d4a-a811-5bd0f639d250 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093023 Jun 17 13:13:32.303105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 962/1830] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:32.650729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd23e928-e223-4c76-90bc-7adc289ce8b6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:32.652257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd23e928-e223-4c76-90bc-7adc289ce8b6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:32.660487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd23e928-e223-4c76-90bc-7adc289ce8b6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:32.660932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd23e928-e223-4c76-90bc-7adc289ce8b6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:32.661690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd23e928-e223-4c76-90bc-7adc289ce8b6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:32.662116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd23e928-e223-4c76-90bc-7adc289ce8b6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:32.679048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:32.692977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd23e928-e223-4c76-90bc-7adc289ce8b6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048939 Jun 17 13:13:32.693553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 869/1831] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:32 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:33.057717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dd719d55-df57-46a7-9fda-3a2f94906ab1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:33.059122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dd719d55-df57-46a7-9fda-3a2f94906ab1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:33.068105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd719d55-df57-46a7-9fda-3a2f94906ab1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:33.068552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd719d55-df57-46a7-9fda-3a2f94906ab1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:33.069341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd719d55-df57-46a7-9fda-3a2f94906ab1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:33.069817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd719d55-df57-46a7-9fda-3a2f94906ab1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:33.108619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dd719d55-df57-46a7-9fda-3a2f94906ab1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057434 Jun 17 13:13:33.109208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 963/1832] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:33.320519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:33.321179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:33.329255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:33.329811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:33.330752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:33.331290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:33.399098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:33.407165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4ff9ad36-ea8a-4b4f-8593-4d9ce2534b00 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091701 Jun 17 13:13:33.407761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 870/1833] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:33.709273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-238cb11f-ce70-411b-a00b-815348accee1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:33.710627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-238cb11f-ce70-411b-a00b-815348accee1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:33.721239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-238cb11f-ce70-411b-a00b-815348accee1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:33.722150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-238cb11f-ce70-411b-a00b-815348accee1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:33.723434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-238cb11f-ce70-411b-a00b-815348accee1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:33.724180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-238cb11f-ce70-411b-a00b-815348accee1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:33.759837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-238cb11f-ce70-411b-a00b-815348accee1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057324 Jun 17 13:13:33.760673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 964/1834] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:33 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:34.126001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1390eef7-ed11-4aa9-90a6-c75f7d9ff925 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:34.126942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1390eef7-ed11-4aa9-90a6-c75f7d9ff925 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:34.134468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1390eef7-ed11-4aa9-90a6-c75f7d9ff925 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:34.134891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1390eef7-ed11-4aa9-90a6-c75f7d9ff925 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:34.135685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1390eef7-ed11-4aa9-90a6-c75f7d9ff925 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:34.136108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1390eef7-ed11-4aa9-90a6-c75f7d9ff925 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:34.176293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1390eef7-ed11-4aa9-90a6-c75f7d9ff925 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057606 Jun 17 13:13:34.176843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 871/1835] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:34.428341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:34.428996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:34.437517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:34.438642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:34.439633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:34.440166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:34.511428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:34.522413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aefc57c1-e239-425f-afb1-5619b9123f4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100103 Jun 17 13:13:34.522986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 965/1836] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:34.776827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6cf070a-d082-4e29-a81e-791b867678f3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:34.778427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6cf070a-d082-4e29-a81e-791b867678f3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:34.786585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6cf070a-d082-4e29-a81e-791b867678f3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:34.787031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6cf070a-d082-4e29-a81e-791b867678f3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:34.787911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6cf070a-d082-4e29-a81e-791b867678f3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:34.788344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6cf070a-d082-4e29-a81e-791b867678f3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:34.818931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6cf070a-d082-4e29-a81e-791b867678f3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048958 Jun 17 13:13:34.819513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 872/1837] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:34 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:35.012070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:13:35.012929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:13:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:13:35.190043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1b18e97-d5ab-44b9-aefc-6066a87a4215 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:35.190972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1b18e97-d5ab-44b9-aefc-6066a87a4215 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:35.198490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1b18e97-d5ab-44b9-aefc-6066a87a4215 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:35.198932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1b18e97-d5ab-44b9-aefc-6066a87a4215 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:35.199742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1b18e97-d5ab-44b9-aefc-6066a87a4215 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:35.200170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1b18e97-d5ab-44b9-aefc-6066a87a4215 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:35.231381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1b18e97-d5ab-44b9-aefc-6066a87a4215 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046636 Jun 17 13:13:35.231957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 966/1838] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:35.541199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:35.541867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:35.549774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:35.550295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:35.551226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:35.551774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:35.616795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:35.624727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4fd42729-519b-4cbd-8b20-e0558fa498d3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088474 Jun 17 13:13:35.625288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 873/1839] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:35.833787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-91ba07e5-e2ed-4c0a-9e8f-336116f195f9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:35.835138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-91ba07e5-e2ed-4c0a-9e8f-336116f195f9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:35.845413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91ba07e5-e2ed-4c0a-9e8f-336116f195f9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:35.846102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91ba07e5-e2ed-4c0a-9e8f-336116f195f9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:35.847255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91ba07e5-e2ed-4c0a-9e8f-336116f195f9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:35.847963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-91ba07e5-e2ed-4c0a-9e8f-336116f195f9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:35.880985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-91ba07e5-e2ed-4c0a-9e8f-336116f195f9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053508 Jun 17 13:13:35.881531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 967/1840] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:35 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:36.245705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9e9d1931-c137-4499-aad2-a6f0edec6d1e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:36.246681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9e9d1931-c137-4499-aad2-a6f0edec6d1e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:36.253054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e9d1931-c137-4499-aad2-a6f0edec6d1e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:36.253480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e9d1931-c137-4499-aad2-a6f0edec6d1e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:36.254628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e9d1931-c137-4499-aad2-a6f0edec6d1e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:36.255053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e9d1931-c137-4499-aad2-a6f0edec6d1e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:36.285986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9e9d1931-c137-4499-aad2-a6f0edec6d1e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Jun 17 13:13:36.286557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 874/1841] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:36.646055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:36.647032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:36.657972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:36.658734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:36.660029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:36.660734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:36.726184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:36.734549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-92d0c10b-2150-4524-87a7-c289b6591ca7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094918 Jun 17 13:13:36.735104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 968/1842] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:36.898133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9646ebfa-0e8b-475b-9f85-003351c51c63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:36.899684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9646ebfa-0e8b-475b-9f85-003351c51c63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:36.902684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=83 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:36.911151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9646ebfa-0e8b-475b-9f85-003351c51c63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:36.911891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9646ebfa-0e8b-475b-9f85-003351c51c63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:36.913052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9646ebfa-0e8b-475b-9f85-003351c51c63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:36.913716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9646ebfa-0e8b-475b-9f85-003351c51c63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:36.944747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9646ebfa-0e8b-475b-9f85-003351c51c63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053075 Jun 17 13:13:36.945298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 875/1843] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:36 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:37.302661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bde86231-8c0f-4d33-a093-7906e17d112f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:37.304255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bde86231-8c0f-4d33-a093-7906e17d112f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:37.315653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bde86231-8c0f-4d33-a093-7906e17d112f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:37.316411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bde86231-8c0f-4d33-a093-7906e17d112f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:37.317666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bde86231-8c0f-4d33-a093-7906e17d112f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:37.318389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bde86231-8c0f-4d33-a093-7906e17d112f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:37.349858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bde86231-8c0f-4d33-a093-7906e17d112f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053965 Jun 17 13:13:37.350407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 969/1844] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:37.761297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:37.762069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:37.771607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:37.772615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:37.772785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:37.773215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:37.847295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:37.855766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2303ae93-e482-4b3b-8802-b59d74c8db85 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099950 Jun 17 13:13:37.856332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 876/1845] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:37.957832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b78a484b-5f57-43fc-9929-cacfc12b08f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:37.958835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b78a484b-5f57-43fc-9929-cacfc12b08f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:37.965611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b78a484b-5f57-43fc-9929-cacfc12b08f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:37.966061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b78a484b-5f57-43fc-9929-cacfc12b08f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:37.966839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b78a484b-5f57-43fc-9929-cacfc12b08f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:37.967271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b78a484b-5f57-43fc-9929-cacfc12b08f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:37.996864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b78a484b-5f57-43fc-9929-cacfc12b08f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Jun 17 13:13:37.997420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 970/1846] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:37 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:38.362218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d8ac5d6c-290c-48b2-9324-706733e4e402 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:38.363148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d8ac5d6c-290c-48b2-9324-706733e4e402 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:38.370686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8ac5d6c-290c-48b2-9324-706733e4e402 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:38.371172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8ac5d6c-290c-48b2-9324-706733e4e402 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:38.372189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8ac5d6c-290c-48b2-9324-706733e4e402 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:38.372588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8ac5d6c-290c-48b2-9324-706733e4e402 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:38.405005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d8ac5d6c-290c-48b2-9324-706733e4e402 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046718 Jun 17 13:13:38.405569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 877/1847] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:38.877709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:38.879083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:38.888707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:38.889137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:38.889886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:38.890310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:38.964897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:38.972803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-490f363d-2331-4c1f-8840-67d7b9e5b7cc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.101639 Jun 17 13:13:38.973545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 971/1848] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:39.009279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6fd85289-e327-41e5-871d-bf44ee170d04 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:39.010215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6fd85289-e327-41e5-871d-bf44ee170d04 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:39.017027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fd85289-e327-41e5-871d-bf44ee170d04 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:39.017478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fd85289-e327-41e5-871d-bf44ee170d04 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:39.018243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fd85289-e327-41e5-871d-bf44ee170d04 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:39.018685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fd85289-e327-41e5-871d-bf44ee170d04 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:39.048302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6fd85289-e327-41e5-871d-bf44ee170d04 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Jun 17 13:13:39.048862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 878/1849] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:39 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:39.421576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-792461f5-d29a-47ad-9c2a-5665a64f9d33 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:39.423110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-792461f5-d29a-47ad-9c2a-5665a64f9d33 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:39.433297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792461f5-d29a-47ad-9c2a-5665a64f9d33 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:39.433729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792461f5-d29a-47ad-9c2a-5665a64f9d33 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:39.434477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792461f5-d29a-47ad-9c2a-5665a64f9d33 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:39.434897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-792461f5-d29a-47ad-9c2a-5665a64f9d33 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:39.464916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-792461f5-d29a-47ad-9c2a-5665a64f9d33 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050157 Jun 17 13:13:39.465473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 972/1850] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:39.994118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:39.995045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:40.002782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:40.003219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:40.004370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:40.004793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:40.062701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c633953f-7ee5-4db4-a015-b200c06643b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:40.063638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c633953f-7ee5-4db4-a015-b200c06643b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:40.070328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c633953f-7ee5-4db4-a015-b200c06643b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:40.070767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c633953f-7ee5-4db4-a015-b200c06643b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:40.071550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c633953f-7ee5-4db4-a015-b200c06643b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:40.071975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c633953f-7ee5-4db4-a015-b200c06643b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:40.076450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:40.084507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3fd9ea6b-3862-4e48-830c-901d376e7613 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096923 Jun 17 13:13:40.085070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 879/1851] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:40.102354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c633953f-7ee5-4db4-a015-b200c06643b8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Jun 17 13:13:40.102908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 973/1852] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:40 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:40.482075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cb02046d-6fc3-49ed-b2aa-cb1132f0e8ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:40.482950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cb02046d-6fc3-49ed-b2aa-cb1132f0e8ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:40.489779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb02046d-6fc3-49ed-b2aa-cb1132f0e8ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:40.490227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb02046d-6fc3-49ed-b2aa-cb1132f0e8ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:40.490995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb02046d-6fc3-49ed-b2aa-cb1132f0e8ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:40.491525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb02046d-6fc3-49ed-b2aa-cb1132f0e8ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:40.522738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cb02046d-6fc3-49ed-b2aa-cb1132f0e8ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Jun 17 13:13:40.523288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 880/1853] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:41.105912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:41.106681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:41.113589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:41.114038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:41.114787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-59be227f-6704-4abd-856b-cfe88d691e48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:41.115226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:41.115226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:41.115750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-59be227f-6704-4abd-856b-cfe88d691e48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:41.122735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59be227f-6704-4abd-856b-cfe88d691e48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:41.123177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59be227f-6704-4abd-856b-cfe88d691e48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:41.123970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59be227f-6704-4abd-856b-cfe88d691e48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:41.124407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59be227f-6704-4abd-856b-cfe88d691e48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:41.155260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-59be227f-6704-4abd-856b-cfe88d691e48 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Jun 17 13:13:41.155869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 881/1854] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:41 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:13:41.181829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:41.189979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2960dce3-094c-4ea3-a9d7-d5e90282165d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090597 Jun 17 13:13:41.190540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 974/1855] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:41.535004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-684b28b5-5eed-431a-8ae5-e4c39f2e2378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:41.535938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-684b28b5-5eed-431a-8ae5-e4c39f2e2378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:41.543947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-684b28b5-5eed-431a-8ae5-e4c39f2e2378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:41.544406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-684b28b5-5eed-431a-8ae5-e4c39f2e2378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:41.545565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-684b28b5-5eed-431a-8ae5-e4c39f2e2378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:41.546162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-684b28b5-5eed-431a-8ae5-e4c39f2e2378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:41.581549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-684b28b5-5eed-431a-8ae5-e4c39f2e2378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050534 Jun 17 13:13:41.582105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 882/1856] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:42.166408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71bf9ac1-5119-4147-a74d-6ba368409cef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:42.167305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71bf9ac1-5119-4147-a74d-6ba368409cef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:42.174747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bf9ac1-5119-4147-a74d-6ba368409cef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:42.175192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bf9ac1-5119-4147-a74d-6ba368409cef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:42.175983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bf9ac1-5119-4147-a74d-6ba368409cef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:42.176400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bf9ac1-5119-4147-a74d-6ba368409cef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:42.205384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71bf9ac1-5119-4147-a74d-6ba368409cef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042787 Jun 17 13:13:42.206388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 975/1857] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:42 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:42.210592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:42.211236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:42.218449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:42.218888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:42.219693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:42.220115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:42.293390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:42.301705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c72bfd09-8f71-4a74-aa05-b2edfcdf937f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095035 Jun 17 13:13:42.302287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 883/1858] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:42.597375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-69d158d4-b47e-47cc-a32f-90232a5bd20f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:42.598288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-69d158d4-b47e-47cc-a32f-90232a5bd20f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:42.605059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69d158d4-b47e-47cc-a32f-90232a5bd20f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:42.605477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69d158d4-b47e-47cc-a32f-90232a5bd20f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:42.606229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69d158d4-b47e-47cc-a32f-90232a5bd20f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:42.606665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69d158d4-b47e-47cc-a32f-90232a5bd20f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:42.636816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-69d158d4-b47e-47cc-a32f-90232a5bd20f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Jun 17 13:13:42.637371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 976/1859] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:43.220502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f9963adc-06ff-480d-8a1e-629ff2194225 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:43.221715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f9963adc-06ff-480d-8a1e-629ff2194225 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:43.229293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9963adc-06ff-480d-8a1e-629ff2194225 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:43.229741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9963adc-06ff-480d-8a1e-629ff2194225 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:43.230511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9963adc-06ff-480d-8a1e-629ff2194225 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:43.230942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9963adc-06ff-480d-8a1e-629ff2194225 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:43.261912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f9963adc-06ff-480d-8a1e-629ff2194225 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Jun 17 13:13:43.262470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 884/1860] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:43 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:43.318475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:43.319085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:43.326020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:43.326462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:43.327217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:43.327642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:43.392205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:43.400340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ec52164f-017b-48bc-9cd6-9f5a1d703be3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086069 Jun 17 13:13:43.400903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 977/1861] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:43.650904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cadfe69d-ad7d-4d5c-9466-049c5b3c8bd1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:43.651777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cadfe69d-ad7d-4d5c-9466-049c5b3c8bd1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:43.658405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cadfe69d-ad7d-4d5c-9466-049c5b3c8bd1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:43.658854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cadfe69d-ad7d-4d5c-9466-049c5b3c8bd1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:43.659661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cadfe69d-ad7d-4d5c-9466-049c5b3c8bd1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:43.660091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cadfe69d-ad7d-4d5c-9466-049c5b3c8bd1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:43.690328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cadfe69d-ad7d-4d5c-9466-049c5b3c8bd1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Jun 17 13:13:43.690873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 885/1862] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:43 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:44.274124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c714f686-d51e-4801-8a4e-79dcb4e23e52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:44.275087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c714f686-d51e-4801-8a4e-79dcb4e23e52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:44.281709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c714f686-d51e-4801-8a4e-79dcb4e23e52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:44.282156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c714f686-d51e-4801-8a4e-79dcb4e23e52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:44.282917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c714f686-d51e-4801-8a4e-79dcb4e23e52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:44.283352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c714f686-d51e-4801-8a4e-79dcb4e23e52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:44.309893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:44.315071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c714f686-d51e-4801-8a4e-79dcb4e23e52 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Jun 17 13:13:44.315680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 978/1863] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:44 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:44.421539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:44.422388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:44.430655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:44.431105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:44.431907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:44.432345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:44.436384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:44.502936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:44.511416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2294193f-557a-4046-ba62-94be1d555653 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096503 Jun 17 13:13:44.511978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 886/1864] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:44.702957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08b7ad60-38ac-4546-9476-f3a18000bc6c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:44.703811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08b7ad60-38ac-4546-9476-f3a18000bc6c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:44.711777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08b7ad60-38ac-4546-9476-f3a18000bc6c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:44.712225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08b7ad60-38ac-4546-9476-f3a18000bc6c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:44.712985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08b7ad60-38ac-4546-9476-f3a18000bc6c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:44.713415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08b7ad60-38ac-4546-9476-f3a18000bc6c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:44.743683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08b7ad60-38ac-4546-9476-f3a18000bc6c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044829 Jun 17 13:13:44.744235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 979/1865] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:45.332689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-354b05c8-1db2-4994-96ba-831b7365306d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:45.335126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-354b05c8-1db2-4994-96ba-831b7365306d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:45.345745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-354b05c8-1db2-4994-96ba-831b7365306d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:45.346454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-354b05c8-1db2-4994-96ba-831b7365306d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:45.347762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-354b05c8-1db2-4994-96ba-831b7365306d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:45.348470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-354b05c8-1db2-4994-96ba-831b7365306d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:45.379099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-354b05c8-1db2-4994-96ba-831b7365306d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052643 Jun 17 13:13:45.379606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 887/1866] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:45 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:45.533275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:45.534332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:45.541686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:45.542171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:45.542926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:45.543354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:45.604893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:45.612611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-323687dd-a242-43f3-affc-2df1c566d1c4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085934 Jun 17 13:13:45.613183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 980/1867] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:45.760382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-12be0cb0-a7f2-43f7-8da6-f4f9e4159b2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:45.761940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-12be0cb0-a7f2-43f7-8da6-f4f9e4159b2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:45.772461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12be0cb0-a7f2-43f7-8da6-f4f9e4159b2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:45.772911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12be0cb0-a7f2-43f7-8da6-f4f9e4159b2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:45.773673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12be0cb0-a7f2-43f7-8da6-f4f9e4159b2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:45.774124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12be0cb0-a7f2-43f7-8da6-f4f9e4159b2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:45.804489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-12be0cb0-a7f2-43f7-8da6-f4f9e4159b2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051573 Jun 17 13:13:45.805045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 888/1868] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:46.395817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-175c5648-f5f1-49f0-92ef-96158b3a7786 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:46.397227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-175c5648-f5f1-49f0-92ef-96158b3a7786 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:46.408234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-175c5648-f5f1-49f0-92ef-96158b3a7786 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:46.408977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-175c5648-f5f1-49f0-92ef-96158b3a7786 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:46.410237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-175c5648-f5f1-49f0-92ef-96158b3a7786 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:46.410973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-175c5648-f5f1-49f0-92ef-96158b3a7786 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:46.442575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-175c5648-f5f1-49f0-92ef-96158b3a7786 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053662 Jun 17 13:13:46.443136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 981/1869] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:46 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:46.629789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:46.630390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:46.637315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:46.637768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:46.638524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:46.638956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:46.701259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:46.709053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-85cb339b-dfce-4507-9e12-4ea4194ef8b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083599 Jun 17 13:13:46.709615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 889/1870] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:46.823361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d0deb093-f714-41eb-925e-c4a59f29f16e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:46.824886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d0deb093-f714-41eb-925e-c4a59f29f16e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:46.837143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0deb093-f714-41eb-925e-c4a59f29f16e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:46.837772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0deb093-f714-41eb-925e-c4a59f29f16e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:46.838563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0deb093-f714-41eb-925e-c4a59f29f16e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:46.838991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0deb093-f714-41eb-925e-c4a59f29f16e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:46.868816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d0deb093-f714-41eb-925e-c4a59f29f16e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052544 Jun 17 13:13:46.869375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 982/1871] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:47.459897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1531d8b1-bad5-49c2-a5e8-744a7031681c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:47.461300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1531d8b1-bad5-49c2-a5e8-744a7031681c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:47.468669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1531d8b1-bad5-49c2-a5e8-744a7031681c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:47.469113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1531d8b1-bad5-49c2-a5e8-744a7031681c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:47.469874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1531d8b1-bad5-49c2-a5e8-744a7031681c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:47.470304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1531d8b1-bad5-49c2-a5e8-744a7031681c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:47.499903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1531d8b1-bad5-49c2-a5e8-744a7031681c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 Jun 17 13:13:47.500452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 890/1872] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:47 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:47.736014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:47.736890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:47.746831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:47.747275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:47.748057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:47.748480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:47.821871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:47.829945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-351e2694-b4d5-41c6-8380-4a65309637c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100828 Jun 17 13:13:47.830521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 983/1873] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:47.880577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f96e9aec-3b2a-4924-b68c-a22ebac7ec6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:47.881507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f96e9aec-3b2a-4924-b68c-a22ebac7ec6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:47.888263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f96e9aec-3b2a-4924-b68c-a22ebac7ec6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:47.888703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f96e9aec-3b2a-4924-b68c-a22ebac7ec6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:47.889467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f96e9aec-3b2a-4924-b68c-a22ebac7ec6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:47.889893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f96e9aec-3b2a-4924-b68c-a22ebac7ec6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:47.919680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f96e9aec-3b2a-4924-b68c-a22ebac7ec6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Jun 17 13:13:47.920197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 891/1874] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:48.516033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3a01ccb3-3163-4b39-827c-ff7465a602a2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:48.517588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3a01ccb3-3163-4b39-827c-ff7465a602a2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:48.526219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a01ccb3-3163-4b39-827c-ff7465a602a2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:48.526709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a01ccb3-3163-4b39-827c-ff7465a602a2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:48.527467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a01ccb3-3163-4b39-827c-ff7465a602a2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:48.527900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3a01ccb3-3163-4b39-827c-ff7465a602a2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:48.557499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3a01ccb3-3163-4b39-827c-ff7465a602a2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048052 Jun 17 13:13:48.558042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 984/1875] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:48 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:48.852207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:48.853112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:48.860563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:48.861017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:48.861784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:48.862219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:48.927697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:48.932211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-53c6cd1a-01bc-4c29-bf51-c77c1b4b06dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:48.933136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-53c6cd1a-01bc-4c29-bf51-c77c1b4b06dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:48.935690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-19c6ef22-14b6-4aa7-b5c5-17c7a0419251 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090166 Jun 17 13:13:48.936594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 892/1876] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:48.939926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53c6cd1a-01bc-4c29-bf51-c77c1b4b06dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:48.940376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53c6cd1a-01bc-4c29-bf51-c77c1b4b06dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:48.941140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53c6cd1a-01bc-4c29-bf51-c77c1b4b06dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:48.941595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53c6cd1a-01bc-4c29-bf51-c77c1b4b06dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:48.971392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-53c6cd1a-01bc-4c29-bf51-c77c1b4b06dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Jun 17 13:13:48.971917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 985/1877] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:49.573560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bbdee256-7e63-45d5-9357-1c643f5a824f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:49.574484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bbdee256-7e63-45d5-9357-1c643f5a824f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:49.580965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbdee256-7e63-45d5-9357-1c643f5a824f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:49.581415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbdee256-7e63-45d5-9357-1c643f5a824f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:49.582183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbdee256-7e63-45d5-9357-1c643f5a824f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:49.582616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbdee256-7e63-45d5-9357-1c643f5a824f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:49.612263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bbdee256-7e63-45d5-9357-1c643f5a824f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044534 Jun 17 13:13:49.612808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 893/1878] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:49 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:49.958087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:49.959100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:49.967640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:49.968087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:49.968855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:49.969271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:49.985184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ef41224d-cc1e-4067-bc56-c3d7ca9f467b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:49.986107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ef41224d-cc1e-4067-bc56-c3d7ca9f467b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:49.992947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef41224d-cc1e-4067-bc56-c3d7ca9f467b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:49.993393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef41224d-cc1e-4067-bc56-c3d7ca9f467b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:49.994216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef41224d-cc1e-4067-bc56-c3d7ca9f467b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:49.994646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ef41224d-cc1e-4067-bc56-c3d7ca9f467b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:50.026788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ef41224d-cc1e-4067-bc56-c3d7ca9f467b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Jun 17 13:13:50.027392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 894/1879] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:50.032551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:50.040306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6171aa5e-33ae-47e5-be0a-7d278c1d408d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089081 Jun 17 13:13:50.040897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 986/1880] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:50.624150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0716c031-871d-4be1-a74f-d31dc66122fd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:50.625073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0716c031-871d-4be1-a74f-d31dc66122fd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:50.632049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0716c031-871d-4be1-a74f-d31dc66122fd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:50.632502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0716c031-871d-4be1-a74f-d31dc66122fd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:50.633263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0716c031-871d-4be1-a74f-d31dc66122fd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:50.633694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0716c031-871d-4be1-a74f-d31dc66122fd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:50.663429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0716c031-871d-4be1-a74f-d31dc66122fd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043291 Jun 17 13:13:50.663976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 895/1881] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:51.043123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f77975a8-3701-4eeb-b1e6-a49136eadd07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:51.044339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f77975a8-3701-4eeb-b1e6-a49136eadd07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:51.052475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f77975a8-3701-4eeb-b1e6-a49136eadd07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:51.053025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f77975a8-3701-4eeb-b1e6-a49136eadd07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:51.053863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f77975a8-3701-4eeb-b1e6-a49136eadd07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:51.054362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f77975a8-3701-4eeb-b1e6-a49136eadd07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:51.059183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:51.060019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:51.067736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:51.068260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:51.069151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:51.069643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:51.089230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f77975a8-3701-4eeb-b1e6-a49136eadd07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052856 Jun 17 13:13:51.089785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 987/1882] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:51.139059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:51.147147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cdb4c760-6864-43b8-aec8-e2c2e623af05 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092660 Jun 17 13:13:51.147753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 896/1883] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:13:51.679625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-28743475-7c4a-46f9-a474-af2615960b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:51.681094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-28743475-7c4a-46f9-a474-af2615960b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:51.694740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28743475-7c4a-46f9-a474-af2615960b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:51.695540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28743475-7c4a-46f9-a474-af2615960b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:51.696801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28743475-7c4a-46f9-a474-af2615960b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:51.697455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28743475-7c4a-46f9-a474-af2615960b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:51.727066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-28743475-7c4a-46f9-a474-af2615960b40 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054255 Jun 17 13:13:51.727661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 988/1884] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:51 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:52.105663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3955cfd4-f08c-4b26-9aa0-4c11004cac3c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:52.107199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3955cfd4-f08c-4b26-9aa0-4c11004cac3c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:52.118520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3955cfd4-f08c-4b26-9aa0-4c11004cac3c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:52.119255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3955cfd4-f08c-4b26-9aa0-4c11004cac3c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:52.120599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3955cfd4-f08c-4b26-9aa0-4c11004cac3c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:52.120719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3955cfd4-f08c-4b26-9aa0-4c11004cac3c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:52.151430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3955cfd4-f08c-4b26-9aa0-4c11004cac3c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052533 Jun 17 13:13:52.152024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 897/1885] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:52.165142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:52.166387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:52.174243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:52.175110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:52.176556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:52.177327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:52.243550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:52.251560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-77461806-2acb-4b2b-9c6b-8f36b4778fb1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091469 Jun 17 13:13:52.252121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 989/1886] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:52.745042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4e5b2ebd-4569-4bf4-92a8-e785e13f6d1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:52.746065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4e5b2ebd-4569-4bf4-92a8-e785e13f6d1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:52.753574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ebd-4569-4bf4-92a8-e785e13f6d1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:52.754068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ebd-4569-4bf4-92a8-e785e13f6d1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:52.754909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ebd-4569-4bf4-92a8-e785e13f6d1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:52.755411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e5b2ebd-4569-4bf4-92a8-e785e13f6d1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:52.786909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4e5b2ebd-4569-4bf4-92a8-e785e13f6d1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048387 Jun 17 13:13:52.787482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 898/1887] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:53.164286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-60b58353-28e8-45dc-a793-5dd87bf57aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:53.165216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-60b58353-28e8-45dc-a793-5dd87bf57aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:53.172335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60b58353-28e8-45dc-a793-5dd87bf57aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:53.172781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60b58353-28e8-45dc-a793-5dd87bf57aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:53.173546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60b58353-28e8-45dc-a793-5dd87bf57aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:53.173975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-60b58353-28e8-45dc-a793-5dd87bf57aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:53.207784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-60b58353-28e8-45dc-a793-5dd87bf57aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047495 Jun 17 13:13:53.208371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 990/1888] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:53.272386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:53.273614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:53.284881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:53.285635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:53.286886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:53.287678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:53.361863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:53.369956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8d9e5a8e-03d4-4d09-8871-410c43ec5ef9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.103853 Jun 17 13:13:53.370530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 899/1889] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:53.798622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-beaec97f-6afe-4162-be88-e83f7fe5b8f0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:53.799679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-beaec97f-6afe-4162-be88-e83f7fe5b8f0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:53.806049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beaec97f-6afe-4162-be88-e83f7fe5b8f0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:53.806571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beaec97f-6afe-4162-be88-e83f7fe5b8f0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:53.807528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beaec97f-6afe-4162-be88-e83f7fe5b8f0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:53.807969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-beaec97f-6afe-4162-be88-e83f7fe5b8f0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:53.837447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-beaec97f-6afe-4162-be88-e83f7fe5b8f0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043016 Jun 17 13:13:53.838447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 991/1890] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:54.224110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c5abb80e-4e98-437d-8609-24a1966ba9d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:54.225601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c5abb80e-4e98-437d-8609-24a1966ba9d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:54.235708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5abb80e-4e98-437d-8609-24a1966ba9d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:54.236457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5abb80e-4e98-437d-8609-24a1966ba9d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:54.237700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5abb80e-4e98-437d-8609-24a1966ba9d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:54.238472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5abb80e-4e98-437d-8609-24a1966ba9d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:54.278157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c5abb80e-4e98-437d-8609-24a1966ba9d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060733 Jun 17 13:13:54.278855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 900/1891] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:54 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:54.391660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:54.392470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:54.401985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:54.402443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:54.403187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:54.403659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:54.474601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:54.486649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2d6c6088-93e0-42c0-b095-afc032d69775 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.101492 Jun 17 13:13:54.487441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 992/1892] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:54.854436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a1cfd81f-1399-482c-b360-e2e4bca0b128 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:54.855482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a1cfd81f-1399-482c-b360-e2e4bca0b128 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:54.863209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a1cfd81f-1399-482c-b360-e2e4bca0b128 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:54.863723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a1cfd81f-1399-482c-b360-e2e4bca0b128 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:54.864548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a1cfd81f-1399-482c-b360-e2e4bca0b128 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:54.865018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a1cfd81f-1399-482c-b360-e2e4bca0b128 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:54.903205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a1cfd81f-1399-482c-b360-e2e4bca0b128 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055496 Jun 17 13:13:54.903956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 901/1893] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:55.294765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a0fe4740-10ef-42f4-90b3-ac9879fb5d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:55.296299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a0fe4740-10ef-42f4-90b3-ac9879fb5d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:55.307406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0fe4740-10ef-42f4-90b3-ac9879fb5d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:55.307870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0fe4740-10ef-42f4-90b3-ac9879fb5d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:55.308631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0fe4740-10ef-42f4-90b3-ac9879fb5d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:55.309057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0fe4740-10ef-42f4-90b3-ac9879fb5d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:55.338836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a0fe4740-10ef-42f4-90b3-ac9879fb5d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 Jun 17 13:13:55.339397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 993/1894] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:55.504827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:55.505436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:55.512241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:55.512691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:55.513458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:55.513897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:55.581544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:55.585094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:55.590384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-439c193c-06fb-488a-bf79-cafe54114d96 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089966 Jun 17 13:13:55.590937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 902/1895] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:55.921699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b3a559d1-f78e-49d3-9d87-f01295b712e5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:55.923194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b3a559d1-f78e-49d3-9d87-f01295b712e5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:55.932786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3a559d1-f78e-49d3-9d87-f01295b712e5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:55.933235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3a559d1-f78e-49d3-9d87-f01295b712e5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:55.934001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3a559d1-f78e-49d3-9d87-f01295b712e5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:55.934436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b3a559d1-f78e-49d3-9d87-f01295b712e5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:55.964241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b3a559d1-f78e-49d3-9d87-f01295b712e5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049520 Jun 17 13:13:55.964799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 994/1896] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:55 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:56.351311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-92c05519-5e6d-4297-ad02-e4853bb712dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:56.352274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-92c05519-5e6d-4297-ad02-e4853bb712dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:56.359476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c05519-5e6d-4297-ad02-e4853bb712dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:56.359924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c05519-5e6d-4297-ad02-e4853bb712dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:56.360685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c05519-5e6d-4297-ad02-e4853bb712dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:56.361114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c05519-5e6d-4297-ad02-e4853bb712dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:56.391823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-92c05519-5e6d-4297-ad02-e4853bb712dd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Jun 17 13:13:56.392293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 903/1897] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:56 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:56.607599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:56.608205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:56.615307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:56.615795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:56.616568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:56.616998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:56.635791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:56.691912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:56.699709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b4bae3d6-ccbb-49cc-9119-ea624818643a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096063 Jun 17 13:13:56.700271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 995/1898] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:56.979790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-25ae68a7-a6c5-4bee-ae23-76cb51f8dcbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:56.980664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-25ae68a7-a6c5-4bee-ae23-76cb51f8dcbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:56.987177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25ae68a7-a6c5-4bee-ae23-76cb51f8dcbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:56.987655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25ae68a7-a6c5-4bee-ae23-76cb51f8dcbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:56.988422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25ae68a7-a6c5-4bee-ae23-76cb51f8dcbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:56.988938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25ae68a7-a6c5-4bee-ae23-76cb51f8dcbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:57.020394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-25ae68a7-a6c5-4bee-ae23-76cb51f8dcbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Jun 17 13:13:57.020953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 904/1899] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:57.403046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fbef7c86-753e-43c3-b495-4e0148c7f2bb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:57.404021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fbef7c86-753e-43c3-b495-4e0148c7f2bb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:57.410576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbef7c86-753e-43c3-b495-4e0148c7f2bb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:57.411022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbef7c86-753e-43c3-b495-4e0148c7f2bb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:57.411817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbef7c86-753e-43c3-b495-4e0148c7f2bb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:57.412241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbef7c86-753e-43c3-b495-4e0148c7f2bb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:57.441804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fbef7c86-753e-43c3-b495-4e0148c7f2bb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Jun 17 13:13:57.442366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 996/1900] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:57 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:57.721287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:57.722115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:57.734200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:57.734647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:57.735403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:57.735864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:57.807484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:57.815929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e0339adf-5f94-4887-8a10-7263bc5d31df tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.101249 Jun 17 13:13:57.816560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 905/1901] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:58.036708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2dee6116-bdd4-4794-b6a8-334ad935c855 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:58.038178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2dee6116-bdd4-4794-b6a8-334ad935c855 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:58.050023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dee6116-bdd4-4794-b6a8-334ad935c855 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:58.050750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dee6116-bdd4-4794-b6a8-334ad935c855 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:58.052049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dee6116-bdd4-4794-b6a8-334ad935c855 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:58.052756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dee6116-bdd4-4794-b6a8-334ad935c855 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:58.086923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2dee6116-bdd4-4794-b6a8-334ad935c855 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056880 Jun 17 13:13:58.087632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 997/1902] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:58.458846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd2c6226-b1c6-41ad-ab50-7ccb1af2bda4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:58.460282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd2c6226-b1c6-41ad-ab50-7ccb1af2bda4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:58.471217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd2c6226-b1c6-41ad-ab50-7ccb1af2bda4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:58.471993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd2c6226-b1c6-41ad-ab50-7ccb1af2bda4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:58.473239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd2c6226-b1c6-41ad-ab50-7ccb1af2bda4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:58.473986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd2c6226-b1c6-41ad-ab50-7ccb1af2bda4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:58.506453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd2c6226-b1c6-41ad-ab50-7ccb1af2bda4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054313 Jun 17 13:13:58.507005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 906/1903] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:58 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:58.837525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:58.838369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:58.845225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:58.845691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:58.846478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:58.846927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:58.909641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:13:58.917322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e32a2ece-c26b-4f3b-a8e0-f83af6fc887b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086446 Jun 17 13:13:58.917878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 998/1904] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:13:59.103617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-96ac3b00-53aa-4896-8d1e-4c919cc8685d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:59.104625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-96ac3b00-53aa-4896-8d1e-4c919cc8685d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:59.112401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96ac3b00-53aa-4896-8d1e-4c919cc8685d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:59.112901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96ac3b00-53aa-4896-8d1e-4c919cc8685d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:59.113758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96ac3b00-53aa-4896-8d1e-4c919cc8685d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:59.114239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96ac3b00-53aa-4896-8d1e-4c919cc8685d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:59.148015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-96ac3b00-53aa-4896-8d1e-4c919cc8685d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051535 Jun 17 13:13:59.149037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 907/1905] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:59.519297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-af68032d-13aa-4cea-ab67-d58f081462f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:59.520253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-af68032d-13aa-4cea-ab67-d58f081462f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:59.527422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af68032d-13aa-4cea-ab67-d58f081462f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:59.527856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af68032d-13aa-4cea-ab67-d58f081462f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:59.528615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af68032d-13aa-4cea-ab67-d58f081462f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:59.529047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af68032d-13aa-4cea-ab67-d58f081462f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:59.558590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-af68032d-13aa-4cea-ab67-d58f081462f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Jun 17 13:13:59.559123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 999/1906] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:13:59 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:13:59.938827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:13:59.939884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:13:59.949224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:59.949671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:13:59.950435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:13:59.950868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:00.014987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:00.023026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df84332c-b8a2-4507-b69b-6b36a298ff1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091251 Jun 17 13:14:00.023628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 908/1907] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:13:59 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:00.161143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b49cf118-8735-467c-80a5-c0a99ee70326 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:00.162057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b49cf118-8735-467c-80a5-c0a99ee70326 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:00.168688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b49cf118-8735-467c-80a5-c0a99ee70326 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:00.169131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b49cf118-8735-467c-80a5-c0a99ee70326 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:00.169887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b49cf118-8735-467c-80a5-c0a99ee70326 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:00.170319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b49cf118-8735-467c-80a5-c0a99ee70326 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:00.200285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b49cf118-8735-467c-80a5-c0a99ee70326 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Jun 17 13:14:00.200849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1000/1908] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:00.573667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dfdfe98f-b5eb-4b07-add9-26e9d3c3a499 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:00.574602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dfdfe98f-b5eb-4b07-add9-26e9d3c3a499 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:00.581601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfdfe98f-b5eb-4b07-add9-26e9d3c3a499 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:00.582100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfdfe98f-b5eb-4b07-add9-26e9d3c3a499 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:00.582858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfdfe98f-b5eb-4b07-add9-26e9d3c3a499 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:00.583598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dfdfe98f-b5eb-4b07-add9-26e9d3c3a499 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:00.613741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dfdfe98f-b5eb-4b07-add9-26e9d3c3a499 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Jun 17 13:14:00.614262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 909/1909] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:01.045278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:01.046271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:01.049905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=82 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:01.058307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:01.058772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:01.059570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:01.059996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:01.123415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:01.131616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-85187b17-5636-483c-a19a-329e548480a1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093539 Jun 17 13:14:01.132180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1001/1910] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:01.218399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e9f349a5-8edd-4508-9b04-33302a2bbc59 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:01.219991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e9f349a5-8edd-4508-9b04-33302a2bbc59 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:01.230154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f349a5-8edd-4508-9b04-33302a2bbc59 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:01.230899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f349a5-8edd-4508-9b04-33302a2bbc59 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:01.232210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f349a5-8edd-4508-9b04-33302a2bbc59 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:01.232930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f349a5-8edd-4508-9b04-33302a2bbc59 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:01.267211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e9f349a5-8edd-4508-9b04-33302a2bbc59 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055883 Jun 17 13:14:01.267798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 910/1911] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:01.698262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11947a8c-2e0c-426d-aae6-3430d6667e7f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:01.699181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11947a8c-2e0c-426d-aae6-3430d6667e7f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:01.705715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11947a8c-2e0c-426d-aae6-3430d6667e7f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:01.706155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11947a8c-2e0c-426d-aae6-3430d6667e7f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:01.706914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11947a8c-2e0c-426d-aae6-3430d6667e7f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:01.707338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11947a8c-2e0c-426d-aae6-3430d6667e7f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:01.737823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11947a8c-2e0c-426d-aae6-3430d6667e7f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115145 Jun 17 13:14:01.738370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1002/1912] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:02.149182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:02.149830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:02.157060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:02.157508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:02.158263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:02.158701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:02.278447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:02.279035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-97c5ee28-151d-447a-bc44-d2d048579fe3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:02.280297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-97c5ee28-151d-447a-bc44-d2d048579fe3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:02.288000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-85eb837e-3b56-4a49-afd2-b3b0f391e450 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.142492 Jun 17 13:14:02.288815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 911/1913] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:02.289648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97c5ee28-151d-447a-bc44-d2d048579fe3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:02.290158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97c5ee28-151d-447a-bc44-d2d048579fe3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:02.291242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97c5ee28-151d-447a-bc44-d2d048579fe3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:02.291848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97c5ee28-151d-447a-bc44-d2d048579fe3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:02.321762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-97c5ee28-151d-447a-bc44-d2d048579fe3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Jun 17 13:14:02.322327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1003/1914] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:02 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:02.754341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f542fa2-9253-4f9d-a97f-426d4428fc90 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:02.755887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f542fa2-9253-4f9d-a97f-426d4428fc90 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:02.766297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f542fa2-9253-4f9d-a97f-426d4428fc90 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:02.767036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f542fa2-9253-4f9d-a97f-426d4428fc90 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:02.768349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f542fa2-9253-4f9d-a97f-426d4428fc90 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:02.769064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f542fa2-9253-4f9d-a97f-426d4428fc90 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:02.802007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f542fa2-9253-4f9d-a97f-426d4428fc90 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054720 Jun 17 13:14:02.802571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 912/1915] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:03.309521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:03.310124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:03.317085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:03.317533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:03.318291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:03.318725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:03.334046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-49cf658e-2954-423f-be8e-7d2e0c65b4b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:03.335059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-49cf658e-2954-423f-be8e-7d2e0c65b4b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:03.343663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49cf658e-2954-423f-be8e-7d2e0c65b4b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:03.344101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49cf658e-2954-423f-be8e-7d2e0c65b4b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:03.344859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49cf658e-2954-423f-be8e-7d2e0c65b4b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:03.345289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-49cf658e-2954-423f-be8e-7d2e0c65b4b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:03.377004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-49cf658e-2954-423f-be8e-7d2e0c65b4b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046858 Jun 17 13:14:03.378059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 913/1916] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:03.381115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:03.389393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-44b5e792-461a-4106-836a-761b936fdf38 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086416 Jun 17 13:14:03.389954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1004/1917] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:03.814082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-000edf82-df41-4dc7-844e-4ba0dc8c57cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:03.815015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-000edf82-df41-4dc7-844e-4ba0dc8c57cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:03.821929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-000edf82-df41-4dc7-844e-4ba0dc8c57cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:03.822372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-000edf82-df41-4dc7-844e-4ba0dc8c57cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:03.823135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-000edf82-df41-4dc7-844e-4ba0dc8c57cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:03.823606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-000edf82-df41-4dc7-844e-4ba0dc8c57cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:03.856225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-000edf82-df41-4dc7-844e-4ba0dc8c57cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Jun 17 13:14:03.856868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 914/1918] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:04.391344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95b683a4-c58d-477d-a23d-5e5b508731ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:04.392272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95b683a4-c58d-477d-a23d-5e5b508731ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:04.399163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95b683a4-c58d-477d-a23d-5e5b508731ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:04.399645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95b683a4-c58d-477d-a23d-5e5b508731ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:04.400404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95b683a4-c58d-477d-a23d-5e5b508731ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:04.400860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95b683a4-c58d-477d-a23d-5e5b508731ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:04.406933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:04.407702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:04.414194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:04.414640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:04.415628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:04.416068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:04.431912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95b683a4-c58d-477d-a23d-5e5b508731ec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Jun 17 13:14:04.432789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1005/1919] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:04.479431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:04.487968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fe4570bd-80ef-429c-b7d0-e493404368ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085629 Jun 17 13:14:04.488574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 915/1920] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:04.872461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9b6f7230-33e5-4386-8de0-26962bfea47f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:04.873419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9b6f7230-33e5-4386-8de0-26962bfea47f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:04.880528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6f7230-33e5-4386-8de0-26962bfea47f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:04.880979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6f7230-33e5-4386-8de0-26962bfea47f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:04.881745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6f7230-33e5-4386-8de0-26962bfea47f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:04.882184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6f7230-33e5-4386-8de0-26962bfea47f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:04.911866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9b6f7230-33e5-4386-8de0-26962bfea47f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Jun 17 13:14:04.912417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1006/1921] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:05.448244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3e54db8-78be-408b-b622-fef31792e8d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:05.449859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f3e54db8-78be-408b-b622-fef31792e8d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:05.461322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3e54db8-78be-408b-b622-fef31792e8d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:05.462065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3e54db8-78be-408b-b622-fef31792e8d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:05.463324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3e54db8-78be-408b-b622-fef31792e8d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:05.464088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3e54db8-78be-408b-b622-fef31792e8d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:05.493934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f3e54db8-78be-408b-b622-fef31792e8d0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052487 Jun 17 13:14:05.494482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 916/1922] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:05 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:05.505458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:05.506033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:05.513850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:05.514285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:05.515041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:05.515507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:05.581260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:05.588980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-82ded52f-646a-4b8c-88f8-630304da49d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087797 Jun 17 13:14:05.589540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1007/1923] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:05.928078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1f54d91-318d-4327-a0bf-51a61e8d8989 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:05.929637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1f54d91-318d-4327-a0bf-51a61e8d8989 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:05.940053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1f54d91-318d-4327-a0bf-51a61e8d8989 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:05.940787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1f54d91-318d-4327-a0bf-51a61e8d8989 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:05.942022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1f54d91-318d-4327-a0bf-51a61e8d8989 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:05.942728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1f54d91-318d-4327-a0bf-51a61e8d8989 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:05.980911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1f54d91-318d-4327-a0bf-51a61e8d8989 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059366 Jun 17 13:14:05.981472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 917/1924] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:06.506821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-63ab9ede-5d42-435a-ad32-979ab2cacdeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:06.507787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-63ab9ede-5d42-435a-ad32-979ab2cacdeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:06.515031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ab9ede-5d42-435a-ad32-979ab2cacdeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:06.515509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ab9ede-5d42-435a-ad32-979ab2cacdeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:06.516266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ab9ede-5d42-435a-ad32-979ab2cacdeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:06.516698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ab9ede-5d42-435a-ad32-979ab2cacdeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:06.546418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-63ab9ede-5d42-435a-ad32-979ab2cacdeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Jun 17 13:14:06.546965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1008/1925] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:06 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:06.607891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:06.608469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:06.615401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:06.615868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:06.616621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:06.617033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:06.683809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:06.691920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6a2f13f-a531-4662-8011-e6dc621e1c52 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089619 Jun 17 13:14:06.692484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 918/1926] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:06.997160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f0e6431-0699-4b4b-8995-b108e1916f48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:06.998087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f0e6431-0699-4b4b-8995-b108e1916f48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:07.004935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6431-0699-4b4b-8995-b108e1916f48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:07.005383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6431-0699-4b4b-8995-b108e1916f48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:07.006143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6431-0699-4b4b-8995-b108e1916f48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:07.006570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6431-0699-4b4b-8995-b108e1916f48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:07.037173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f0e6431-0699-4b4b-8995-b108e1916f48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Jun 17 13:14:07.037702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1009/1927] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:07.562735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b515cfd6-0ffc-485c-98d6-11632df2effe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:07.564241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b515cfd6-0ffc-485c-98d6-11632df2effe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:07.567231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=88 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:07.575886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b515cfd6-0ffc-485c-98d6-11632df2effe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:07.576329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b515cfd6-0ffc-485c-98d6-11632df2effe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:07.577093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b515cfd6-0ffc-485c-98d6-11632df2effe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:07.577515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b515cfd6-0ffc-485c-98d6-11632df2effe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:07.594548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:07.608120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b515cfd6-0ffc-485c-98d6-11632df2effe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052257 Jun 17 13:14:07.608888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 919/1928] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:07 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:07.713374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:07.714376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:07.721839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:07.722291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:07.723055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:07.723525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:07.795063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:07.806249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-10c3d077-b72c-44e3-bd62-8bbe5973f804 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099053 Jun 17 13:14:07.807110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1010/1929] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:08.049578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-da465d9d-03b8-4a2e-b314-971143b57d95 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:08.050659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-da465d9d-03b8-4a2e-b314-971143b57d95 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:08.058903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da465d9d-03b8-4a2e-b314-971143b57d95 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:08.059742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da465d9d-03b8-4a2e-b314-971143b57d95 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:08.060639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da465d9d-03b8-4a2e-b314-971143b57d95 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:08.061156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da465d9d-03b8-4a2e-b314-971143b57d95 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:08.095550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-da465d9d-03b8-4a2e-b314-971143b57d95 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050659 Jun 17 13:14:08.096118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 920/1930] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:08.623354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9f7d5e10-b5a7-4c48-bbb6-5f9492ab985d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:08.624301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9f7d5e10-b5a7-4c48-bbb6-5f9492ab985d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:08.631085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e10-b5a7-4c48-bbb6-5f9492ab985d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:08.631557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e10-b5a7-4c48-bbb6-5f9492ab985d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:08.632300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e10-b5a7-4c48-bbb6-5f9492ab985d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:08.632722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f7d5e10-b5a7-4c48-bbb6-5f9492ab985d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:08.662078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9f7d5e10-b5a7-4c48-bbb6-5f9492ab985d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Jun 17 13:14:08.662620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1011/1931] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:08 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:08.826910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:08.827609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:08.834412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:08.834895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:08.835733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:08.836181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:08.899472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:08.907551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4d985e84-4421-4e15-bb25-c25821b29967 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085959 Jun 17 13:14:08.908109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 921/1932] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:09.110578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0dc8b5f6-aa2f-4e40-bf2c-5df70b8472c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:09.111787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0dc8b5f6-aa2f-4e40-bf2c-5df70b8472c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:09.120362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc8b5f6-aa2f-4e40-bf2c-5df70b8472c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:09.120928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc8b5f6-aa2f-4e40-bf2c-5df70b8472c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:09.121884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc8b5f6-aa2f-4e40-bf2c-5df70b8472c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:09.122315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dc8b5f6-aa2f-4e40-bf2c-5df70b8472c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:09.126165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:09.153690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0dc8b5f6-aa2f-4e40-bf2c-5df70b8472c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048443 Jun 17 13:14:09.154170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1012/1933] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:09.679213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9edbbfbc-8fe3-4da9-9569-f9f10017e1d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:09.680767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9edbbfbc-8fe3-4da9-9569-f9f10017e1d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:09.691860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9edbbfbc-8fe3-4da9-9569-f9f10017e1d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:09.692601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9edbbfbc-8fe3-4da9-9569-f9f10017e1d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:09.693849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9edbbfbc-8fe3-4da9-9569-f9f10017e1d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:09.694576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9edbbfbc-8fe3-4da9-9569-f9f10017e1d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:09.727184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9edbbfbc-8fe3-4da9-9569-f9f10017e1d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054588 Jun 17 13:14:09.727766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 922/1934] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:09 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:09.928883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:09.930020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:09.938126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:09.938573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:09.939335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:09.939801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:10.011124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:10.019013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-40352974-a58a-4c8c-854e-f5253778d9f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096905 Jun 17 13:14:10.019606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1013/1935] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:09 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:10.169332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8956a92f-9926-4423-8f8a-3369d98f872c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:10.170715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8956a92f-9926-4423-8f8a-3369d98f872c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:10.180415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8956a92f-9926-4423-8f8a-3369d98f872c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:10.180957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8956a92f-9926-4423-8f8a-3369d98f872c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:10.182174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8956a92f-9926-4423-8f8a-3369d98f872c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:10.182777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8956a92f-9926-4423-8f8a-3369d98f872c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:10.213850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8956a92f-9926-4423-8f8a-3369d98f872c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050781 Jun 17 13:14:10.214417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 923/1936] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:10.740418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-472fe41e-963e-4a92-b7f8-18e1baa9e287 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:10.741343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-472fe41e-963e-4a92-b7f8-18e1baa9e287 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:10.748420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-472fe41e-963e-4a92-b7f8-18e1baa9e287 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:10.748868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-472fe41e-963e-4a92-b7f8-18e1baa9e287 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:10.749621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-472fe41e-963e-4a92-b7f8-18e1baa9e287 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:10.750047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-472fe41e-963e-4a92-b7f8-18e1baa9e287 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:10.781452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-472fe41e-963e-4a92-b7f8-18e1baa9e287 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Jun 17 13:14:10.782021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1014/1937] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:10 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:11.040521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.041527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.049563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.050053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.050812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.051246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.123017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:11.131744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f4055083-e906-401e-9f41-6c59df6a67ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097685 Jun 17 13:14:11.132302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 924/1938] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:11.231790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-362fa874-45c0-4a40-b298-c5f03b6eeaca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.232707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-362fa874-45c0-4a40-b298-c5f03b6eeaca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.239169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-362fa874-45c0-4a40-b298-c5f03b6eeaca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.239649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-362fa874-45c0-4a40-b298-c5f03b6eeaca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.240407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-362fa874-45c0-4a40-b298-c5f03b6eeaca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.240835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-362fa874-45c0-4a40-b298-c5f03b6eeaca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.271285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-362fa874-45c0-4a40-b298-c5f03b6eeaca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Jun 17 13:14:11.271870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1015/1939] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:11.794314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d83f07a9-6104-4025-ab74-05ca0cddfee2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.794905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d83f07a9-6104-4025-ab74-05ca0cddfee2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.801509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83f07a9-6104-4025-ab74-05ca0cddfee2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.801954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83f07a9-6104-4025-ab74-05ca0cddfee2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.802769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83f07a9-6104-4025-ab74-05ca0cddfee2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.803177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83f07a9-6104-4025-ab74-05ca0cddfee2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.833100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d83f07a9-6104-4025-ab74-05ca0cddfee2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043353 Jun 17 13:14:11.833650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 925/1940] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:11 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:12.149948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.150604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.157600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.158045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.158797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.159227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.221896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:12.229494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3b4e74b6-e290-42aa-ad50-ec259959cccc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083497 Jun 17 13:14:12.230054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1016/1941] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:12.282856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3873394e-e0a7-44ed-be9c-999d5b456b04 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.283772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3873394e-e0a7-44ed-be9c-999d5b456b04 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.290596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3873394e-e0a7-44ed-be9c-999d5b456b04 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.291040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3873394e-e0a7-44ed-be9c-999d5b456b04 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.291832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3873394e-e0a7-44ed-be9c-999d5b456b04 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.292290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3873394e-e0a7-44ed-be9c-999d5b456b04 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.322852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3873394e-e0a7-44ed-be9c-999d5b456b04 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Jun 17 13:14:12.323405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 926/1942] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:12.848790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe7844fe-eec2-4885-8aa9-f20303302f06 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.850283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe7844fe-eec2-4885-8aa9-f20303302f06 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.858833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe7844fe-eec2-4885-8aa9-f20303302f06 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.859279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe7844fe-eec2-4885-8aa9-f20303302f06 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.860073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe7844fe-eec2-4885-8aa9-f20303302f06 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.860479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe7844fe-eec2-4885-8aa9-f20303302f06 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.892510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe7844fe-eec2-4885-8aa9-f20303302f06 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050313 Jun 17 13:14:12.893061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1017/1943] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:13.249693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.250428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.258753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.259316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.260403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.260942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.332460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:13.335090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9d7e430b-dd7b-4ea1-bed3-c6a07d5d5fe6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.336049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9d7e430b-dd7b-4ea1-bed3-c6a07d5d5fe6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.340460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-24277af2-64a6-4a70-ad87-5371eb254b9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096442 Jun 17 13:14:13.341035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 927/1944] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:13.342895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d7e430b-dd7b-4ea1-bed3-c6a07d5d5fe6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.343348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d7e430b-dd7b-4ea1-bed3-c6a07d5d5fe6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.344140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d7e430b-dd7b-4ea1-bed3-c6a07d5d5fe6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.344573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d7e430b-dd7b-4ea1-bed3-c6a07d5d5fe6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.374905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9d7e430b-dd7b-4ea1-bed3-c6a07d5d5fe6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Jun 17 13:14:13.375358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1018/1945] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:13.905244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4fbc05b9-a27a-4c19-8ca1-418114778740 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.906170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4fbc05b9-a27a-4c19-8ca1-418114778740 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.912941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fbc05b9-a27a-4c19-8ca1-418114778740 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.913536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fbc05b9-a27a-4c19-8ca1-418114778740 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.914175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fbc05b9-a27a-4c19-8ca1-418114778740 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.914630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fbc05b9-a27a-4c19-8ca1-418114778740 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.944977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4fbc05b9-a27a-4c19-8ca1-418114778740 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Jun 17 13:14:13.945534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 928/1946] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:14.357676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:14.358254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:14.365162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.365612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.366367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.366800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.386407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1992fd35-998d-47fc-9373-d11091d559a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:14.387860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1992fd35-998d-47fc-9373-d11091d559a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:14.394602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1992fd35-998d-47fc-9373-d11091d559a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.395041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1992fd35-998d-47fc-9373-d11091d559a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.395829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1992fd35-998d-47fc-9373-d11091d559a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.396254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1992fd35-998d-47fc-9373-d11091d559a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.427655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1992fd35-998d-47fc-9373-d11091d559a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Jun 17 13:14:14.428255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 929/1947] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:14.432603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:14.441169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bfd7f18d-6ab3-4926-8d31-726ed5c87bfc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087480 Jun 17 13:14:14.441728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1019/1948] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:14.958556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c1e9a480-57d2-4c2b-8983-cad31eaaec36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:14.959513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c1e9a480-57d2-4c2b-8983-cad31eaaec36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:14.966054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e9a480-57d2-4c2b-8983-cad31eaaec36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.966504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e9a480-57d2-4c2b-8983-cad31eaaec36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.967268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e9a480-57d2-4c2b-8983-cad31eaaec36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.967738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e9a480-57d2-4c2b-8983-cad31eaaec36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.998126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c1e9a480-57d2-4c2b-8983-cad31eaaec36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Jun 17 13:14:14.998980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 930/1949] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:14 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:15.442886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7816158e-be8c-4830-b83c-7f339d5a2d0a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:15.444009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7816158e-be8c-4830-b83c-7f339d5a2d0a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:15.453652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7816158e-be8c-4830-b83c-7f339d5a2d0a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.454121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7816158e-be8c-4830-b83c-7f339d5a2d0a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.455329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7816158e-be8c-4830-b83c-7f339d5a2d0a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.455879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7816158e-be8c-4830-b83c-7f339d5a2d0a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.460493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:15.461164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:15.468698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.469146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.469913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.470341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.488572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7816158e-be8c-4830-b83c-7f339d5a2d0a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051823 Jun 17 13:14:15.489157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1020/1950] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:15.534665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:15.542264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-680ba027-12cb-4d95-b1c7-72f252235566 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087481 Jun 17 13:14:15.542841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 931/1951] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:16.015802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-86a3d925-a60a-4acd-98be-82fc83be95ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:16.017299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-86a3d925-a60a-4acd-98be-82fc83be95ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:16.027784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86a3d925-a60a-4acd-98be-82fc83be95ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.028231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86a3d925-a60a-4acd-98be-82fc83be95ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.028995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86a3d925-a60a-4acd-98be-82fc83be95ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.029428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86a3d925-a60a-4acd-98be-82fc83be95ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.060459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-86a3d925-a60a-4acd-98be-82fc83be95ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051431 Jun 17 13:14:16.060960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1021/1952] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:16 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:16.502911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5e42fc70-88ec-4f1c-8366-3a9d005fab76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:16.504225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5e42fc70-88ec-4f1c-8366-3a9d005fab76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:16.512887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e42fc70-88ec-4f1c-8366-3a9d005fab76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.513394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e42fc70-88ec-4f1c-8366-3a9d005fab76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.514180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e42fc70-88ec-4f1c-8366-3a9d005fab76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.514599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e42fc70-88ec-4f1c-8366-3a9d005fab76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.545651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5e42fc70-88ec-4f1c-8366-3a9d005fab76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048115 Jun 17 13:14:16.546227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 932/1953] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:16.559178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:16.560095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:16.566984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.567423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.568200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.568641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.634002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:16.643146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5343b8e2-4291-4e34-9031-f9ca727ec4b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087837 Jun 17 13:14:16.643750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1022/1954] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:17.076326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3a4440a-edce-4218-9634-8531384aff96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:17.077340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f3a4440a-edce-4218-9634-8531384aff96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:17.084068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3a4440a-edce-4218-9634-8531384aff96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.084522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3a4440a-edce-4218-9634-8531384aff96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.085457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3a4440a-edce-4218-9634-8531384aff96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.085742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3a4440a-edce-4218-9634-8531384aff96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.121678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f3a4440a-edce-4218-9634-8531384aff96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051036 Jun 17 13:14:17.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 933/1955] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:17.557868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dee80720-2d74-4f06-a630-731bcab8768e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:17.559028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dee80720-2d74-4f06-a630-731bcab8768e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:17.565912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee80720-2d74-4f06-a630-731bcab8768e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.566502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee80720-2d74-4f06-a630-731bcab8768e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.567118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee80720-2d74-4f06-a630-731bcab8768e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.567655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dee80720-2d74-4f06-a630-731bcab8768e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.597480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dee80720-2d74-4f06-a630-731bcab8768e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Jun 17 13:14:17.598041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1023/1956] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:17.660992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:17.661908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:17.673258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.674093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.675294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.676073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.760837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:17.774524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b7fbba58-dfe1-435c-bd74-f7629660c3d7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.117672 Jun 17 13:14:17.775568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 934/1957] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:18.139622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7d37fc33-1edb-4985-a3cf-d19356f6513e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:18.140541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7d37fc33-1edb-4985-a3cf-d19356f6513e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:18.147023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d37fc33-1edb-4985-a3cf-d19356f6513e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.147511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d37fc33-1edb-4985-a3cf-d19356f6513e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.148271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d37fc33-1edb-4985-a3cf-d19356f6513e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.148698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d37fc33-1edb-4985-a3cf-d19356f6513e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.191142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7d37fc33-1edb-4985-a3cf-d19356f6513e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055621 Jun 17 13:14:18.191729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1024/1958] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:18 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:18.612185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d5746a00-c70f-4549-8b0d-555d1960eddd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:18.613516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d5746a00-c70f-4549-8b0d-555d1960eddd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:18.623059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5746a00-c70f-4549-8b0d-555d1960eddd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.623709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5746a00-c70f-4549-8b0d-555d1960eddd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.624687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5746a00-c70f-4549-8b0d-555d1960eddd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.625238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5746a00-c70f-4549-8b0d-555d1960eddd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.658378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d5746a00-c70f-4549-8b0d-555d1960eddd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052411 Jun 17 13:14:18.658929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 935/1959] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:18.793556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:18.794149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:18.801382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.801825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.802616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.803047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.876493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:18.889600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0a43800-8d15-4ebd-b176-85e6a9ed4e6e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099712 Jun 17 13:14:18.890487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1025/1960] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:19.206162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-635cc0d6-b0c6-4948-8487-0725671eee23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:19.207192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-635cc0d6-b0c6-4948-8487-0725671eee23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:19.214785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-635cc0d6-b0c6-4948-8487-0725671eee23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.215317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-635cc0d6-b0c6-4948-8487-0725671eee23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.216285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-635cc0d6-b0c6-4948-8487-0725671eee23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.216792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-635cc0d6-b0c6-4948-8487-0725671eee23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.221253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:19.249827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-635cc0d6-b0c6-4948-8487-0725671eee23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049210 Jun 17 13:14:19.250384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 936/1961] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:19 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:19.672496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0a477bb-ec3c-4146-945d-1e1a407e36b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:19.673661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0a477bb-ec3c-4146-945d-1e1a407e36b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:19.682358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a477bb-ec3c-4146-945d-1e1a407e36b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.682937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a477bb-ec3c-4146-945d-1e1a407e36b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.684049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a477bb-ec3c-4146-945d-1e1a407e36b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.684621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a477bb-ec3c-4146-945d-1e1a407e36b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.716589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0a477bb-ec3c-4146-945d-1e1a407e36b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049654 Jun 17 13:14:19.717144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1026/1962] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:19.915599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:19.916580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:19.924522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.924953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.925723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.926160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.998701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:20.010577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-59315af1-b662-4111-bc33-7346a47a89b4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.101311 Jun 17 13:14:20.011311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 937/1963] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:20.262409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a950942-9dc7-4dda-aab5-b7c05bfb1fc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:20.263331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a950942-9dc7-4dda-aab5-b7c05bfb1fc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:20.270388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a950942-9dc7-4dda-aab5-b7c05bfb1fc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.270834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a950942-9dc7-4dda-aab5-b7c05bfb1fc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.271650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a950942-9dc7-4dda-aab5-b7c05bfb1fc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.272080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a950942-9dc7-4dda-aab5-b7c05bfb1fc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.301230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a950942-9dc7-4dda-aab5-b7c05bfb1fc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042865 Jun 17 13:14:20.301783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1027/1964] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:20 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:20.732315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9ad2b244-7800-4909-b276-b6a589e8bbf7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:20.733313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9ad2b244-7800-4909-b276-b6a589e8bbf7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:20.740522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ad2b244-7800-4909-b276-b6a589e8bbf7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.741031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ad2b244-7800-4909-b276-b6a589e8bbf7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.741808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ad2b244-7800-4909-b276-b6a589e8bbf7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.742299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ad2b244-7800-4909-b276-b6a589e8bbf7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.774290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9ad2b244-7800-4909-b276-b6a589e8bbf7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046933 Jun 17 13:14:20.774872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 938/1965] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:21.034186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:21.034794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:21.043894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.044475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.045764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.046474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.117043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:21.120410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:21.127774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0880c08-7c94-4bb2-ae41-729e816f4856 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097352 Jun 17 13:14:21.128335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1028/1966] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:21 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:21.315881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aadb65f8-fd82-4f7e-9e72-7d2d4ff9b1e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:21.316853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aadb65f8-fd82-4f7e-9e72-7d2d4ff9b1e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:21.323472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aadb65f8-fd82-4f7e-9e72-7d2d4ff9b1e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.323935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aadb65f8-fd82-4f7e-9e72-7d2d4ff9b1e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.324700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aadb65f8-fd82-4f7e-9e72-7d2d4ff9b1e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.325135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aadb65f8-fd82-4f7e-9e72-7d2d4ff9b1e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.355414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aadb65f8-fd82-4f7e-9e72-7d2d4ff9b1e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Jun 17 13:14:21.355972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 939/1967] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:21.792886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d2cbf90f-697e-44e7-9390-77ed18add261 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:21.794374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d2cbf90f-697e-44e7-9390-77ed18add261 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:21.807062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2cbf90f-697e-44e7-9390-77ed18add261 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.807860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2cbf90f-697e-44e7-9390-77ed18add261 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.809774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2cbf90f-697e-44e7-9390-77ed18add261 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.810166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2cbf90f-697e-44e7-9390-77ed18add261 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.842321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d2cbf90f-697e-44e7-9390-77ed18add261 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056484 Jun 17 13:14:21.842874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1029/1968] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:22.145595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:22.146201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:22.153181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.153640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.154367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.154793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.219586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:22.231086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c58a47ab-333f-4185-97c7-01610f0e7640 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089277 Jun 17 13:14:22.231939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 940/1969] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:22.368914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c6e81c13-d83f-4ddb-8e96-93aa19e95822 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:22.370078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c6e81c13-d83f-4ddb-8e96-93aa19e95822 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:22.378714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6e81c13-d83f-4ddb-8e96-93aa19e95822 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.379239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6e81c13-d83f-4ddb-8e96-93aa19e95822 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.380266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6e81c13-d83f-4ddb-8e96-93aa19e95822 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.380762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6e81c13-d83f-4ddb-8e96-93aa19e95822 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.412555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c6e81c13-d83f-4ddb-8e96-93aa19e95822 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048331 Jun 17 13:14:22.413105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1030/1970] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:22 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:22.855406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7d4f0ceb-c322-4902-9961-c64c114185cc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:22.856355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7d4f0ceb-c322-4902-9961-c64c114185cc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:22.863110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4f0ceb-c322-4902-9961-c64c114185cc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.863597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4f0ceb-c322-4902-9961-c64c114185cc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.864378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4f0ceb-c322-4902-9961-c64c114185cc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.864798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d4f0ceb-c322-4902-9961-c64c114185cc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.894899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7d4f0ceb-c322-4902-9961-c64c114185cc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Jun 17 13:14:22.895481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 941/1971] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:23.252888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:23.253488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:23.260663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.261109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.261862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.262295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.335986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:23.344113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6a363d94-fa3b-4037-b5c1-23e9dbb93bec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097215 Jun 17 13:14:23.344682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1031/1972] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:23.424642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cad072af-6ead-44f2-9c96-1879c8e3c45e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:23.425649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cad072af-6ead-44f2-9c96-1879c8e3c45e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:23.432648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cad072af-6ead-44f2-9c96-1879c8e3c45e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.433092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cad072af-6ead-44f2-9c96-1879c8e3c45e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.433847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cad072af-6ead-44f2-9c96-1879c8e3c45e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.434267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cad072af-6ead-44f2-9c96-1879c8e3c45e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.468586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cad072af-6ead-44f2-9c96-1879c8e3c45e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048445 Jun 17 13:14:23.469142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 942/1973] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:23 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:23.910906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cfadad51-998f-4054-b4d1-b8da0b1068c6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:23.912454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cfadad51-998f-4054-b4d1-b8da0b1068c6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:23.922942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cfadad51-998f-4054-b4d1-b8da0b1068c6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.923835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cfadad51-998f-4054-b4d1-b8da0b1068c6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.924609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cfadad51-998f-4054-b4d1-b8da0b1068c6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.925053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cfadad51-998f-4054-b4d1-b8da0b1068c6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.953796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cfadad51-998f-4054-b4d1-b8da0b1068c6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049668 Jun 17 13:14:23.954268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1032/1974] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:24.363912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:24.364525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:24.370762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.371236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.372025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.372429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.438653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:24.446444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6ec9800c-4902-4b11-bc45-071a550a28ec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087707 Jun 17 13:14:24.446978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 943/1975] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:24.480984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a466e4c4-a50f-4137-9b01-2a4c49cc32d5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:24.481933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a466e4c4-a50f-4137-9b01-2a4c49cc32d5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:24.488877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a466e4c4-a50f-4137-9b01-2a4c49cc32d5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.489327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a466e4c4-a50f-4137-9b01-2a4c49cc32d5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.490106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a466e4c4-a50f-4137-9b01-2a4c49cc32d5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.490543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a466e4c4-a50f-4137-9b01-2a4c49cc32d5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.528130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a466e4c4-a50f-4137-9b01-2a4c49cc32d5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051180 Jun 17 13:14:24.528737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1033/1976] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:24.970181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-614d7b07-84e9-4dac-9e7f-8d25535e93bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:24.971562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-614d7b07-84e9-4dac-9e7f-8d25535e93bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:24.978088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-614d7b07-84e9-4dac-9e7f-8d25535e93bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.978527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-614d7b07-84e9-4dac-9e7f-8d25535e93bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.979292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-614d7b07-84e9-4dac-9e7f-8d25535e93bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.979736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-614d7b07-84e9-4dac-9e7f-8d25535e93bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.010655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-614d7b07-84e9-4dac-9e7f-8d25535e93bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Jun 17 13:14:25.011204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 944/1977] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:25.463925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:25.464526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:25.471772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.472348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.473122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.473592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.543684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-887375f3-6be7-4afe-8946-67a21df182d1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:25.544576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:25.544984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-887375f3-6be7-4afe-8946-67a21df182d1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:25.552215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-887375f3-6be7-4afe-8946-67a21df182d1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.552747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-887375f3-6be7-4afe-8946-67a21df182d1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.552973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1463b084-5cf0-4d5d-b8b7-e5f529ce6fea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092959 Jun 17 13:14:25.553575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1034/1978] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:25.553716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-887375f3-6be7-4afe-8946-67a21df182d1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.554055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-887375f3-6be7-4afe-8946-67a21df182d1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.588688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-887375f3-6be7-4afe-8946-67a21df182d1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050364 Jun 17 13:14:25.589245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 945/1979] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:25 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:26.023284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a3b7d02e-71f1-438a-896a-4c0898fe2b73 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:26.024230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a3b7d02e-71f1-438a-896a-4c0898fe2b73 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:26.030783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3b7d02e-71f1-438a-896a-4c0898fe2b73 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.031219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3b7d02e-71f1-438a-896a-4c0898fe2b73 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.031991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3b7d02e-71f1-438a-896a-4c0898fe2b73 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.032415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3b7d02e-71f1-438a-896a-4c0898fe2b73 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.062471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a3b7d02e-71f1-438a-896a-4c0898fe2b73 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Jun 17 13:14:26.062933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1035/1980] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:26.572977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:26.573562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:26.581003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.581537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.582312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.582746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.602369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b6ebc064-5b95-41b3-9b12-0a547669868e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:26.603272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b6ebc064-5b95-41b3-9b12-0a547669868e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:26.609637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6ebc064-5b95-41b3-9b12-0a547669868e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.610175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6ebc064-5b95-41b3-9b12-0a547669868e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.611157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6ebc064-5b95-41b3-9b12-0a547669868e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.611609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6ebc064-5b95-41b3-9b12-0a547669868e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.645577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b6ebc064-5b95-41b3-9b12-0a547669868e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047914 Jun 17 13:14:26.645985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:26.646473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1036/1981] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:14:26.655830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ab710099-200d-4a37-891f-879897406156 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088953 Jun 17 13:14:26.656634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 946/1982] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:27.078962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ea1abdd2-7340-4511-9b01-a420c07e6baf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:27.080419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ea1abdd2-7340-4511-9b01-a420c07e6baf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:27.091071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea1abdd2-7340-4511-9b01-a420c07e6baf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.091870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea1abdd2-7340-4511-9b01-a420c07e6baf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.093123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea1abdd2-7340-4511-9b01-a420c07e6baf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.093849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea1abdd2-7340-4511-9b01-a420c07e6baf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.126435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ea1abdd2-7340-4511-9b01-a420c07e6baf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054229 Jun 17 13:14:27.127008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1037/1983] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:27.660819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f5595c77-4890-4d16-aca1-0cc12beac9f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:27.662151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f5595c77-4890-4d16-aca1-0cc12beac9f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:27.671652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5595c77-4890-4d16-aca1-0cc12beac9f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.672297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5595c77-4890-4d16-aca1-0cc12beac9f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.673360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5595c77-4890-4d16-aca1-0cc12beac9f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.674007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5595c77-4890-4d16-aca1-0cc12beac9f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.679337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:27.680046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:27.686788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.687234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.688012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.688440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.704528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f5595c77-4890-4d16-aca1-0cc12beac9f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049715 Jun 17 13:14:27.705093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 947/1984] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:27.751612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:27.759981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-387176a4-b676-4669-a054-b06583bfbbb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085118 Jun 17 13:14:27.760545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1038/1985] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:28.138868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-71d9594c-a2bf-41b6-8456-f343443642b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:28.139871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-71d9594c-a2bf-41b6-8456-f343443642b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:28.146645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71d9594c-a2bf-41b6-8456-f343443642b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.147091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71d9594c-a2bf-41b6-8456-f343443642b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.147877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71d9594c-a2bf-41b6-8456-f343443642b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.148307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71d9594c-a2bf-41b6-8456-f343443642b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.177119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-71d9594c-a2bf-41b6-8456-f343443642b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Jun 17 13:14:28.177665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 948/1986] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:28.718995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef2516f8-a9eb-4ca3-9780-2da3b84bef54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:28.720249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef2516f8-a9eb-4ca3-9780-2da3b84bef54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:28.728506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef2516f8-a9eb-4ca3-9780-2da3b84bef54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.728946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef2516f8-a9eb-4ca3-9780-2da3b84bef54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.729699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef2516f8-a9eb-4ca3-9780-2da3b84bef54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.730123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef2516f8-a9eb-4ca3-9780-2da3b84bef54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.760850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef2516f8-a9eb-4ca3-9780-2da3b84bef54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Jun 17 13:14:28.761387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1039/1987] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:28.777926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:28.778538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:28.785679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.786152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.786912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.787499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.852011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:28.859901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8eb75957-8505-4719-a3ab-e15ffc2da05e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085930 Jun 17 13:14:28.860473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 949/1988] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:29.191992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-898a11e6-9799-48f7-b9fe-e2082002a8de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:29.193258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-898a11e6-9799-48f7-b9fe-e2082002a8de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:29.200206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-898a11e6-9799-48f7-b9fe-e2082002a8de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.200642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-898a11e6-9799-48f7-b9fe-e2082002a8de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.201421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-898a11e6-9799-48f7-b9fe-e2082002a8de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.201880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-898a11e6-9799-48f7-b9fe-e2082002a8de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.232144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-898a11e6-9799-48f7-b9fe-e2082002a8de tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Jun 17 13:14:29.232706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1040/1989] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:29.777095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62056ceb-cdee-4148-860a-5cd6565e5aaf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:29.778507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62056ceb-cdee-4148-860a-5cd6565e5aaf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:29.789163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62056ceb-cdee-4148-860a-5cd6565e5aaf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.789971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62056ceb-cdee-4148-860a-5cd6565e5aaf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.791191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62056ceb-cdee-4148-860a-5cd6565e5aaf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.791926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62056ceb-cdee-4148-860a-5cd6565e5aaf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.828256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62056ceb-cdee-4148-860a-5cd6565e5aaf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057902 Jun 17 13:14:29.829000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 950/1990] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:29 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:29.881891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:29.882507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:29.889993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.890448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.891204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.891674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.955730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:29.963653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bba8a42d-57a9-4492-a3a0-3be5eb8f7cc9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088781 Jun 17 13:14:29.964199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1041/1991] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:30.245892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a59250cb-4f72-44a4-b286-f5be4b090dbf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:30.246930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a59250cb-4f72-44a4-b286-f5be4b090dbf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:30.254334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a59250cb-4f72-44a4-b286-f5be4b090dbf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.254813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a59250cb-4f72-44a4-b286-f5be4b090dbf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.255668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a59250cb-4f72-44a4-b286-f5be4b090dbf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.256123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a59250cb-4f72-44a4-b286-f5be4b090dbf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.286889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a59250cb-4f72-44a4-b286-f5be4b090dbf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045406 Jun 17 13:14:30.287480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 951/1992] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:30 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:30.846118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8a80ea19-016c-4df3-9e72-6c6d6ddcabee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:30.847652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8a80ea19-016c-4df3-9e72-6c6d6ddcabee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:30.855647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a80ea19-016c-4df3-9e72-6c6d6ddcabee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.856099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a80ea19-016c-4df3-9e72-6c6d6ddcabee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.856851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a80ea19-016c-4df3-9e72-6c6d6ddcabee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.857278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a80ea19-016c-4df3-9e72-6c6d6ddcabee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.890657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8a80ea19-016c-4df3-9e72-6c6d6ddcabee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050869 Jun 17 13:14:30.891301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1042/1993] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:30 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:30.990418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:30.991324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:30.999189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.999667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.000448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.000868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.072217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:31.075805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:31.080300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2939c6b6-a60f-4105-9615-72d796375a74 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096275 Jun 17 13:14:31.080869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 952/1994] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:30 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:31.300011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b071d289-c998-482f-8df9-18021630296d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:31.301075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b071d289-c998-482f-8df9-18021630296d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:31.303259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=84 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:31.309362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b071d289-c998-482f-8df9-18021630296d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.309805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b071d289-c998-482f-8df9-18021630296d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.310559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b071d289-c998-482f-8df9-18021630296d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.310986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b071d289-c998-482f-8df9-18021630296d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.343663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b071d289-c998-482f-8df9-18021630296d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048297 Jun 17 13:14:31.344226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1043/1995] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:31.906185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e7500b87-20e5-4671-b497-50b09ca416f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:31.907640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e7500b87-20e5-4671-b497-50b09ca416f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:31.917789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7500b87-20e5-4671-b497-50b09ca416f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.918647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7500b87-20e5-4671-b497-50b09ca416f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.920084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7500b87-20e5-4671-b497-50b09ca416f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.920784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7500b87-20e5-4671-b497-50b09ca416f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.953386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e7500b87-20e5-4671-b497-50b09ca416f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053296 Jun 17 13:14:31.953935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 953/1996] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:32.101568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:32.102115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:32.109328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.109773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.110531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.110961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.178669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:32.186632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c8041d3-d68f-49e9-8d92-5a255db02fe4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091621 Jun 17 13:14:32.187262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1044/1997] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:32.356103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-33ede45c-e93f-4dec-8acc-4921b021e61f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:32.356972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-33ede45c-e93f-4dec-8acc-4921b021e61f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:32.364135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-33ede45c-e93f-4dec-8acc-4921b021e61f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.364580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-33ede45c-e93f-4dec-8acc-4921b021e61f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.365346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-33ede45c-e93f-4dec-8acc-4921b021e61f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.365777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-33ede45c-e93f-4dec-8acc-4921b021e61f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.397350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-33ede45c-e93f-4dec-8acc-4921b021e61f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Jun 17 13:14:32.397901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 954/1998] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:32.969805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95d0e3b0-febd-42f4-81ef-d88d23b8f388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:32.971302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95d0e3b0-febd-42f4-81ef-d88d23b8f388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:32.980355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95d0e3b0-febd-42f4-81ef-d88d23b8f388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.980775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95d0e3b0-febd-42f4-81ef-d88d23b8f388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.981555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95d0e3b0-febd-42f4-81ef-d88d23b8f388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.981987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95d0e3b0-febd-42f4-81ef-d88d23b8f388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.000465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:33.014966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95d0e3b0-febd-42f4-81ef-d88d23b8f388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052183 Jun 17 13:14:33.015587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1045/1999] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:32 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:33.208688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:33.209484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:33.216684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.217135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.217895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.218332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.292227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:33.300360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a725b27a-0704-427d-9d6b-37c315e38f81 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097089 Jun 17 13:14:33.300936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 955/2000] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:33.410971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c66ca6c6-6ff6-478a-9a28-4e342911dbb7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:33.412115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c66ca6c6-6ff6-478a-9a28-4e342911dbb7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:33.420337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c66ca6c6-6ff6-478a-9a28-4e342911dbb7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.420873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c66ca6c6-6ff6-478a-9a28-4e342911dbb7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.421778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c66ca6c6-6ff6-478a-9a28-4e342911dbb7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.422299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c66ca6c6-6ff6-478a-9a28-4e342911dbb7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.454910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c66ca6c6-6ff6-478a-9a28-4e342911dbb7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048636 Jun 17 13:14:33.455671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1046/2001] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:34.028958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1ce15950-b195-4ae0-90b3-523fe681d702 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:34.029871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1ce15950-b195-4ae0-90b3-523fe681d702 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:34.037096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ce15950-b195-4ae0-90b3-523fe681d702 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.037541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ce15950-b195-4ae0-90b3-523fe681d702 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.038291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ce15950-b195-4ae0-90b3-523fe681d702 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.038712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ce15950-b195-4ae0-90b3-523fe681d702 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.068801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1ce15950-b195-4ae0-90b3-523fe681d702 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Jun 17 13:14:34.069266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 956/2002] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:34 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:34.317985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:34.318597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:34.325448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.325849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.326596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.327035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.391204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:34.401840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-957f8dc5-d1bd-4d31-a58c-5dc299c192a3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087576 Jun 17 13:14:34.402410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1047/2003] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:34.473213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd675a79-470e-4921-9884-c750847f02bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:34.474763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd675a79-470e-4921-9884-c750847f02bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:34.482325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd675a79-470e-4921-9884-c750847f02bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.482768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd675a79-470e-4921-9884-c750847f02bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.483560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd675a79-470e-4921-9884-c750847f02bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.483984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd675a79-470e-4921-9884-c750847f02bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.513994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd675a79-470e-4921-9884-c750847f02bc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047435 Jun 17 13:14:34.514517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 957/2004] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:35.084742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d38c8586-a1a7-4b7d-9b00-b306ddd7c918 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:35.086221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d38c8586-a1a7-4b7d-9b00-b306ddd7c918 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:35.097578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d38c8586-a1a7-4b7d-9b00-b306ddd7c918 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.098305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d38c8586-a1a7-4b7d-9b00-b306ddd7c918 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.099582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d38c8586-a1a7-4b7d-9b00-b306ddd7c918 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.100285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d38c8586-a1a7-4b7d-9b00-b306ddd7c918 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.132027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d38c8586-a1a7-4b7d-9b00-b306ddd7c918 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053973 Jun 17 13:14:35.132579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1048/2005] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:35 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:35.425882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:35.426638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:35.434592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.435064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.435892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.436321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.527101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8683e616-01a6-4a4b-9b89-ab6d33aadb88 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:35.528045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8683e616-01a6-4a4b-9b89-ab6d33aadb88 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:35.534898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8683e616-01a6-4a4b-9b89-ab6d33aadb88 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.535309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8683e616-01a6-4a4b-9b89-ab6d33aadb88 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.536135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8683e616-01a6-4a4b-9b89-ab6d33aadb88 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.536553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8683e616-01a6-4a4b-9b89-ab6d33aadb88 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.569659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8683e616-01a6-4a4b-9b89-ab6d33aadb88 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Jun 17 13:14:35.570253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1049/2006] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:35.729427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:35.741731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-79bcf269-204d-4da7-9f0b-a2ba2d8739bb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.320821 Jun 17 13:14:35.742556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 958/2007] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:36.144650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-912fef91-d9c7-48d8-81b2-35ba0086acd2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:36.145585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-912fef91-d9c7-48d8-81b2-35ba0086acd2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:36.152750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-912fef91-d9c7-48d8-81b2-35ba0086acd2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.153198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-912fef91-d9c7-48d8-81b2-35ba0086acd2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.153953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-912fef91-d9c7-48d8-81b2-35ba0086acd2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.154390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-912fef91-d9c7-48d8-81b2-35ba0086acd2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.185171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-912fef91-d9c7-48d8-81b2-35ba0086acd2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Jun 17 13:14:36.185738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1050/2008] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:36 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:36.587535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5e57d78-cb61-4ff0-a060-1c2b9aae7e07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:36.588996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5e57d78-cb61-4ff0-a060-1c2b9aae7e07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:36.601227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5e57d78-cb61-4ff0-a060-1c2b9aae7e07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.601950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5e57d78-cb61-4ff0-a060-1c2b9aae7e07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.603047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5e57d78-cb61-4ff0-a060-1c2b9aae7e07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.603502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5e57d78-cb61-4ff0-a060-1c2b9aae7e07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.633873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5e57d78-cb61-4ff0-a060-1c2b9aae7e07 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053807 Jun 17 13:14:36.634558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 959/2009] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:36.762455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:36.763094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:36.769878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.770344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.771137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.771629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.840521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:36.853962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2de422f-acdf-4bd5-a81e-79344facbd27 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097259 Jun 17 13:14:36.854629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1051/2010] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:37.200609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2fb04b21-d5ad-4e68-9930-a7faad99e2cb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:37.202102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2fb04b21-d5ad-4e68-9930-a7faad99e2cb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:37.212672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fb04b21-d5ad-4e68-9930-a7faad99e2cb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.213410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fb04b21-d5ad-4e68-9930-a7faad99e2cb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.215072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fb04b21-d5ad-4e68-9930-a7faad99e2cb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.215727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fb04b21-d5ad-4e68-9930-a7faad99e2cb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.246210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2fb04b21-d5ad-4e68-9930-a7faad99e2cb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051546 Jun 17 13:14:37.246989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 960/2011] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:37 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:37.649828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-20a95e80-69fe-470e-8ea8-01efe447ba14 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:37.651305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-20a95e80-69fe-470e-8ea8-01efe447ba14 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:37.659776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20a95e80-69fe-470e-8ea8-01efe447ba14 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.660079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20a95e80-69fe-470e-8ea8-01efe447ba14 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.660826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20a95e80-69fe-470e-8ea8-01efe447ba14 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.661250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20a95e80-69fe-470e-8ea8-01efe447ba14 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.691596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-20a95e80-69fe-470e-8ea8-01efe447ba14 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048494 Jun 17 13:14:37.692142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1052/2012] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:37.875301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:37.875937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:37.878676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=84 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:37.884324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.884765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.885520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.885937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.948967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:37.957006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-38b2a11e-b1be-41aa-9826-e363dd778b0d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086557 Jun 17 13:14:37.957562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 961/2013] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:38.263251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1e42554-66e6-4b79-aaaa-99b9d112139c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:38.264195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1e42554-66e6-4b79-aaaa-99b9d112139c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:38.270729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1e42554-66e6-4b79-aaaa-99b9d112139c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.271172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1e42554-66e6-4b79-aaaa-99b9d112139c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.271935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1e42554-66e6-4b79-aaaa-99b9d112139c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.272362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1e42554-66e6-4b79-aaaa-99b9d112139c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.306188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1e42554-66e6-4b79-aaaa-99b9d112139c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049434 Jun 17 13:14:38.306913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1053/2014] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:38 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:38.708993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-79832f3e-844a-4243-9804-9afe14a0597b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:38.710352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-79832f3e-844a-4243-9804-9afe14a0597b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:38.718708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79832f3e-844a-4243-9804-9afe14a0597b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.719156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79832f3e-844a-4243-9804-9afe14a0597b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.719954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79832f3e-844a-4243-9804-9afe14a0597b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.720385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79832f3e-844a-4243-9804-9afe14a0597b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.758551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-79832f3e-844a-4243-9804-9afe14a0597b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056836 Jun 17 13:14:38.759429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 962/2015] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:38.976499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:38.977361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:38.986261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.986698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.987483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.987916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.049876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:39.057907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-feabe5e0-503f-4efc-b116-a57ee4e5ef4f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087415 Jun 17 13:14:39.058474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1054/2016] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:39.327445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02e2f80c-c3db-4f63-a27d-67c931d01a21 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:39.328406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02e2f80c-c3db-4f63-a27d-67c931d01a21 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:39.337882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e2f80c-c3db-4f63-a27d-67c931d01a21 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.338318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e2f80c-c3db-4f63-a27d-67c931d01a21 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.339421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e2f80c-c3db-4f63-a27d-67c931d01a21 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.339954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02e2f80c-c3db-4f63-a27d-67c931d01a21 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.370537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02e2f80c-c3db-4f63-a27d-67c931d01a21 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049040 Jun 17 13:14:39.371113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 963/2017] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:39 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:39.776438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef0735ea-8f08-447e-82c6-c5ac5df16f4c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:39.777935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef0735ea-8f08-447e-82c6-c5ac5df16f4c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:39.788391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef0735ea-8f08-447e-82c6-c5ac5df16f4c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.789140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef0735ea-8f08-447e-82c6-c5ac5df16f4c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.790388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef0735ea-8f08-447e-82c6-c5ac5df16f4c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.791121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef0735ea-8f08-447e-82c6-c5ac5df16f4c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.823231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef0735ea-8f08-447e-82c6-c5ac5df16f4c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053663 Jun 17 13:14:39.823897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1055/2018] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:40.075117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:40.075688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:40.081936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.082383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.083142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.083604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.147298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:40.155176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e8dc2a00-fb69-4f52-adff-9e3024040ba3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084007 Jun 17 13:14:40.156091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 964/2019] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:40 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:40.384842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-34f79f2d-1fb9-45e4-abc1-0e914a5e1842 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:40.385890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-34f79f2d-1fb9-45e4-abc1-0e914a5e1842 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:40.393995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34f79f2d-1fb9-45e4-abc1-0e914a5e1842 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.394438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34f79f2d-1fb9-45e4-abc1-0e914a5e1842 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.395210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34f79f2d-1fb9-45e4-abc1-0e914a5e1842 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.395668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34f79f2d-1fb9-45e4-abc1-0e914a5e1842 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.427842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-34f79f2d-1fb9-45e4-abc1-0e914a5e1842 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Jun 17 13:14:40.428411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1056/2020] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:40 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:40.836616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f909f35-e091-4423-a285-d2a2b88cd660 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:40.837803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f909f35-e091-4423-a285-d2a2b88cd660 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:40.845742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f909f35-e091-4423-a285-d2a2b88cd660 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.846191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f909f35-e091-4423-a285-d2a2b88cd660 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.846938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f909f35-e091-4423-a285-d2a2b88cd660 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.847416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f909f35-e091-4423-a285-d2a2b88cd660 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.878105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f909f35-e091-4423-a285-d2a2b88cd660 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Jun 17 13:14:40.878674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 965/2021] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:41.175031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:41.175758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:41.183107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.183670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.184481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.184952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.256940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:41.267256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e6b0a0fa-6c0a-44b4-b9eb-7957b138ec88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097253 Jun 17 13:14:41.267862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1057/2022] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:41.441835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4c74b701-953f-46a2-9eb9-ff49dfecbfcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:41.443116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4c74b701-953f-46a2-9eb9-ff49dfecbfcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:41.450540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c74b701-953f-46a2-9eb9-ff49dfecbfcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.451010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c74b701-953f-46a2-9eb9-ff49dfecbfcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.452194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c74b701-953f-46a2-9eb9-ff49dfecbfcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.452370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c74b701-953f-46a2-9eb9-ff49dfecbfcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.484068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4c74b701-953f-46a2-9eb9-ff49dfecbfcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047284 Jun 17 13:14:41.484622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 966/2023] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:41 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:41.894407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ca72bf8e-af0a-4fb4-8937-73ec8b1e591b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:41.895845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ca72bf8e-af0a-4fb4-8937-73ec8b1e591b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:41.907047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca72bf8e-af0a-4fb4-8937-73ec8b1e591b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.907852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca72bf8e-af0a-4fb4-8937-73ec8b1e591b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.909103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca72bf8e-af0a-4fb4-8937-73ec8b1e591b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.909828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ca72bf8e-af0a-4fb4-8937-73ec8b1e591b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.943723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ca72bf8e-af0a-4fb4-8937-73ec8b1e591b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056454 Jun 17 13:14:41.944259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1058/2024] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:42.284774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:42.285547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:42.292599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.293043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.293812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.294233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.361068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:42.369218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a840b006-354f-490f-9ff0-13edae8623a8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088569 Jun 17 13:14:42.369726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 967/2025] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:42.500811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8c36061b-4af6-4cdc-ab3f-432ecf859eeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:42.502685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8c36061b-4af6-4cdc-ab3f-432ecf859eeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:42.513089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c36061b-4af6-4cdc-ab3f-432ecf859eeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.513817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c36061b-4af6-4cdc-ab3f-432ecf859eeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.515299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c36061b-4af6-4cdc-ab3f-432ecf859eeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.515912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c36061b-4af6-4cdc-ab3f-432ecf859eeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.545149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8c36061b-4af6-4cdc-ab3f-432ecf859eeb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051653 Jun 17 13:14:42.545691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1059/2026] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:42 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:42.957103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d83055a3-27b0-4a04-a7f5-4cfd36705c48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:42.958036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d83055a3-27b0-4a04-a7f5-4cfd36705c48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:42.964587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83055a3-27b0-4a04-a7f5-4cfd36705c48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.965031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83055a3-27b0-4a04-a7f5-4cfd36705c48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.965787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83055a3-27b0-4a04-a7f5-4cfd36705c48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.966226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d83055a3-27b0-4a04-a7f5-4cfd36705c48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.998758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d83055a3-27b0-4a04-a7f5-4cfd36705c48 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Jun 17 13:14:42.999580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 968/2027] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:43.390817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:43.391472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:43.398524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.398972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.399776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.400206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.462787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:43.470550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b7f34dfd-cfa7-4d4f-817b-f194ef710169 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085759 Jun 17 13:14:43.471116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1060/2028] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:43.561333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-290f87d7-a8e0-466d-ba23-0d38a76c6fcd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:43.562474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-290f87d7-a8e0-466d-ba23-0d38a76c6fcd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:43.569452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290f87d7-a8e0-466d-ba23-0d38a76c6fcd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.569899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290f87d7-a8e0-466d-ba23-0d38a76c6fcd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.570672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290f87d7-a8e0-466d-ba23-0d38a76c6fcd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.571106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290f87d7-a8e0-466d-ba23-0d38a76c6fcd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.588616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:43.602840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-290f87d7-a8e0-466d-ba23-0d38a76c6fcd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048163 Jun 17 13:14:43.603402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 969/2029] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:43 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:44.011666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2adbbe1f-884e-4a82-a08d-8a4a3fb02185 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:44.012595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2adbbe1f-884e-4a82-a08d-8a4a3fb02185 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:44.019389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2adbbe1f-884e-4a82-a08d-8a4a3fb02185 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.019847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2adbbe1f-884e-4a82-a08d-8a4a3fb02185 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.020613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2adbbe1f-884e-4a82-a08d-8a4a3fb02185 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.021046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2adbbe1f-884e-4a82-a08d-8a4a3fb02185 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.051505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2adbbe1f-884e-4a82-a08d-8a4a3fb02185 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043855 Jun 17 13:14:44.052044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1061/2030] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:44.489622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:44.490932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:44.502248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.502680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.503650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.504080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.579016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:44.591149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7f32e86d-8b73-49c9-8f1e-abf90e534a4c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.106644 Jun 17 13:14:44.591833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 970/2031] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:14:44.615135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4e4ef44b-4329-462e-a81e-26e4185020db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:44.616214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4e4ef44b-4329-462e-a81e-26e4185020db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:44.622844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e4ef44b-4329-462e-a81e-26e4185020db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.623292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e4ef44b-4329-462e-a81e-26e4185020db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.624189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e4ef44b-4329-462e-a81e-26e4185020db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.624628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4e4ef44b-4329-462e-a81e-26e4185020db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.628634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:44.654869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4e4ef44b-4329-462e-a81e-26e4185020db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Jun 17 13:14:44.655485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1062/2032] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:44 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:45.065912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-13976bfd-def3-4ac9-aa18-553dcf6f4bb4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:45.066885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-13976bfd-def3-4ac9-aa18-553dcf6f4bb4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:45.073727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13976bfd-def3-4ac9-aa18-553dcf6f4bb4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.074195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13976bfd-def3-4ac9-aa18-553dcf6f4bb4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.074995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13976bfd-def3-4ac9-aa18-553dcf6f4bb4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.075483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13976bfd-def3-4ac9-aa18-553dcf6f4bb4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.106392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-13976bfd-def3-4ac9-aa18-553dcf6f4bb4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046590 Jun 17 13:14:45.106940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 971/2033] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:45.610385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:45.611163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:45.618058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.618688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.619243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.619708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.668933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc174259-8828-4b08-80b8-53fd14674210 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:45.669856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc174259-8828-4b08-80b8-53fd14674210 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:45.676725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc174259-8828-4b08-80b8-53fd14674210 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.677183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc174259-8828-4b08-80b8-53fd14674210 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.677946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc174259-8828-4b08-80b8-53fd14674210 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.678379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc174259-8828-4b08-80b8-53fd14674210 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.681621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:45.689350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-29545ed8-d96b-46d7-9d14-10428478e320 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083873 Jun 17 13:14:45.690258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1063/2034] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:45.708889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc174259-8828-4b08-80b8-53fd14674210 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Jun 17 13:14:45.709410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 972/2035] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:45 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:14:46.121916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c210f605-239b-4eea-9f01-3136aea54f25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:46.123310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c210f605-239b-4eea-9f01-3136aea54f25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:46.133747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c210f605-239b-4eea-9f01-3136aea54f25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.134415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c210f605-239b-4eea-9f01-3136aea54f25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.135622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c210f605-239b-4eea-9f01-3136aea54f25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.136248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c210f605-239b-4eea-9f01-3136aea54f25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.168411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c210f605-239b-4eea-9f01-3136aea54f25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052031 Jun 17 13:14:46.168988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1064/2036] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:46.709486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:46.710126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:46.718678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.719123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.719924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.720354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.721888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-efeee9b9-f6b2-4cad-93d3-a5d44588e78a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:46.722664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-efeee9b9-f6b2-4cad-93d3-a5d44588e78a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:46.728962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efeee9b9-f6b2-4cad-93d3-a5d44588e78a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.729454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efeee9b9-f6b2-4cad-93d3-a5d44588e78a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.730259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efeee9b9-f6b2-4cad-93d3-a5d44588e78a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.730688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efeee9b9-f6b2-4cad-93d3-a5d44588e78a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.763538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-efeee9b9-f6b2-4cad-93d3-a5d44588e78a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Jun 17 13:14:46.764159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1065/2037] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:46 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:46.783566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:46.791304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62865eb4-1181-4b8a-8b69-f11a29eed6da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087528 Jun 17 13:14:46.791897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 973/2038] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:47.181281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a716e77a-f896-428a-87e4-01170b224a69 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:47.182210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a716e77a-f896-428a-87e4-01170b224a69 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:47.188677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a716e77a-f896-428a-87e4-01170b224a69 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.189118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a716e77a-f896-428a-87e4-01170b224a69 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.189863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a716e77a-f896-428a-87e4-01170b224a69 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.190548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a716e77a-f896-428a-87e4-01170b224a69 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.220169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a716e77a-f896-428a-87e4-01170b224a69 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Jun 17 13:14:47.220863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1066/2039] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:47.777738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4a74841b-24f5-41bf-b208-d381455d08e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:47.778766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4a74841b-24f5-41bf-b208-d381455d08e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:47.786547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a74841b-24f5-41bf-b208-d381455d08e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.787044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a74841b-24f5-41bf-b208-d381455d08e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.787921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a74841b-24f5-41bf-b208-d381455d08e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.788397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a74841b-24f5-41bf-b208-d381455d08e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.808640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:47.809245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:47.816142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.816592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.817341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.817770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.821325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4a74841b-24f5-41bf-b208-d381455d08e4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048116 Jun 17 13:14:47.821928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 974/2040] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:47 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:47.882382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:47.890086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ba2b54cc-0404-4a53-88f5-5af04a6b3278 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085340 Jun 17 13:14:47.890618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1067/2041] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:48.236744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8861c639-0551-4f2c-8bc1-f6657aa1610d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:48.238251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8861c639-0551-4f2c-8bc1-f6657aa1610d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:48.249535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8861c639-0551-4f2c-8bc1-f6657aa1610d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.250277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8861c639-0551-4f2c-8bc1-f6657aa1610d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.252033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8861c639-0551-4f2c-8bc1-f6657aa1610d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.252850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8861c639-0551-4f2c-8bc1-f6657aa1610d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.284026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8861c639-0551-4f2c-8bc1-f6657aa1610d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054193 Jun 17 13:14:48.284568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 975/2042] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:48.838031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8989adf1-90dd-4192-b329-d81cd63b3189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:48.839534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8989adf1-90dd-4192-b329-d81cd63b3189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:48.850243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8989adf1-90dd-4192-b329-d81cd63b3189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.850680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8989adf1-90dd-4192-b329-d81cd63b3189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.851449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8989adf1-90dd-4192-b329-d81cd63b3189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.851879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8989adf1-90dd-4192-b329-d81cd63b3189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.882017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8989adf1-90dd-4192-b329-d81cd63b3189 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051425 Jun 17 13:14:48.882563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1068/2043] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:48 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:48.908450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:48.909054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:48.916117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.916565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.917320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.917745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.988676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:48.997001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f964cb27-0579-496f-8989-59e44202a95b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092444 Jun 17 13:14:48.997550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 976/2044] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:49.297119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a706013e-37aa-4f1c-9d4f-d105954067a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:49.298323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a706013e-37aa-4f1c-9d4f-d105954067a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:49.307851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a706013e-37aa-4f1c-9d4f-d105954067a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.308295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a706013e-37aa-4f1c-9d4f-d105954067a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.309058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a706013e-37aa-4f1c-9d4f-d105954067a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.309484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a706013e-37aa-4f1c-9d4f-d105954067a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.339841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a706013e-37aa-4f1c-9d4f-d105954067a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047460 Jun 17 13:14:49.340390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1069/2045] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:49.894493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bba9c6ea-7601-4d4e-b6ac-bcca5321c154 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:49.895500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bba9c6ea-7601-4d4e-b6ac-bcca5321c154 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:49.902401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba9c6ea-7601-4d4e-b6ac-bcca5321c154 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.902851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba9c6ea-7601-4d4e-b6ac-bcca5321c154 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.903656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba9c6ea-7601-4d4e-b6ac-bcca5321c154 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.904091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba9c6ea-7601-4d4e-b6ac-bcca5321c154 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.933303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bba9c6ea-7601-4d4e-b6ac-bcca5321c154 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Jun 17 13:14:49.933968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 977/2046] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:49 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:50.015339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:50.015965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:50.023887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.024327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.025082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.025509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.096355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:50.105978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aaf44815-6812-4b06-a47a-c05de9c7d6ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095168 Jun 17 13:14:50.106590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1070/2047] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:50.354348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a6f9413-f2fc-4ee4-b460-67a0ac75dff2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:50.355221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a6f9413-f2fc-4ee4-b460-67a0ac75dff2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:50.362498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6f9413-f2fc-4ee4-b460-67a0ac75dff2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.363030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6f9413-f2fc-4ee4-b460-67a0ac75dff2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.364397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6f9413-f2fc-4ee4-b460-67a0ac75dff2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.364803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6f9413-f2fc-4ee4-b460-67a0ac75dff2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.402790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a6f9413-f2fc-4ee4-b460-67a0ac75dff2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054326 Jun 17 13:14:50.403360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 978/2048] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:50 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:50.950652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-87896127-6b91-4679-a3ac-13da319d127b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:50.952092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-87896127-6b91-4679-a3ac-13da319d127b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:50.962171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87896127-6b91-4679-a3ac-13da319d127b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.962854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87896127-6b91-4679-a3ac-13da319d127b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.964036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87896127-6b91-4679-a3ac-13da319d127b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.964681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87896127-6b91-4679-a3ac-13da319d127b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.999488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-87896127-6b91-4679-a3ac-13da319d127b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055606 Jun 17 13:14:51.000052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1071/2049] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:51.124729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:51.125559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:51.134141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.134581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.135517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.135885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.207201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:51.215041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4fae56f3-a015-475f-b8d0-e89be56528b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094869 Jun 17 13:14:51.215639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 979/2050] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:51.415152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43bc0880-de80-43a9-89da-1198f9847805 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:51.416148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43bc0880-de80-43a9-89da-1198f9847805 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:51.425751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43bc0880-de80-43a9-89da-1198f9847805 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.426223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43bc0880-de80-43a9-89da-1198f9847805 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.427021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43bc0880-de80-43a9-89da-1198f9847805 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.429498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43bc0880-de80-43a9-89da-1198f9847805 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.470306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43bc0880-de80-43a9-89da-1198f9847805 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059314 Jun 17 13:14:51.470758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1072/2051] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:52.013365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5246a274-7f1d-4075-b5c9-df1867212dbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:52.014578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5246a274-7f1d-4075-b5c9-df1867212dbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:52.023170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5246a274-7f1d-4075-b5c9-df1867212dbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.023766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5246a274-7f1d-4075-b5c9-df1867212dbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.024771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5246a274-7f1d-4075-b5c9-df1867212dbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.025181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5246a274-7f1d-4075-b5c9-df1867212dbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.054442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5246a274-7f1d-4075-b5c9-df1867212dbd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Jun 17 13:14:52.054987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 980/2052] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:52.231701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:52.232307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:52.238946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.239401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.240155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.240578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.304321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:52.316920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7aafde73-ef53-4705-b8ed-e0ef2849961b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088790 Jun 17 13:14:52.317642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1073/2053] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:52.483723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-103e1a01-f7a9-4ed8-ad0b-406f62d2fbf8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:52.484793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-103e1a01-f7a9-4ed8-ad0b-406f62d2fbf8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:52.494697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103e1a01-f7a9-4ed8-ad0b-406f62d2fbf8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.495274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103e1a01-f7a9-4ed8-ad0b-406f62d2fbf8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.496155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103e1a01-f7a9-4ed8-ad0b-406f62d2fbf8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.496781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-103e1a01-f7a9-4ed8-ad0b-406f62d2fbf8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.532400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-103e1a01-f7a9-4ed8-ad0b-406f62d2fbf8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053769 Jun 17 13:14:52.533082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 981/2054] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:53.070586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-684fea5d-af69-46ad-afd7-71d44293a9b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:53.072007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-684fea5d-af69-46ad-afd7-71d44293a9b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:53.079299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-684fea5d-af69-46ad-afd7-71d44293a9b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.079783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-684fea5d-af69-46ad-afd7-71d44293a9b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.080549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-684fea5d-af69-46ad-afd7-71d44293a9b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.080998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-684fea5d-af69-46ad-afd7-71d44293a9b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.111443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-684fea5d-af69-46ad-afd7-71d44293a9b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047515 Jun 17 13:14:53.112026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1074/2055] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:53.343043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:53.343975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:53.353921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.354369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.355139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.355612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.422882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:53.431902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5ed1b4c1-83ca-429e-8b05-17c4173a9f2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097593 Jun 17 13:14:53.432508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 982/2056] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:53.547003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cf0938c7-a32a-4469-9ea5-17e70562b5b6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:53.548290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cf0938c7-a32a-4469-9ea5-17e70562b5b6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:53.557500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0938c7-a32a-4469-9ea5-17e70562b5b6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.557921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0938c7-a32a-4469-9ea5-17e70562b5b6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.558702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0938c7-a32a-4469-9ea5-17e70562b5b6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.559132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0938c7-a32a-4469-9ea5-17e70562b5b6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.589847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cf0938c7-a32a-4469-9ea5-17e70562b5b6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048728 Jun 17 13:14:53.590398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1075/2057] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:54.123895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4a5c611b-07bc-4b21-85d0-c686f706efcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:54.124840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4a5c611b-07bc-4b21-85d0-c686f706efcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:54.132392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a5c611b-07bc-4b21-85d0-c686f706efcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.132585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a5c611b-07bc-4b21-85d0-c686f706efcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.133231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a5c611b-07bc-4b21-85d0-c686f706efcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.133667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a5c611b-07bc-4b21-85d0-c686f706efcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.167250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4a5c611b-07bc-4b21-85d0-c686f706efcb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Jun 17 13:14:54.167842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 983/2058] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:14:54.451032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:54.451939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:54.462885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.463478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.464282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.464722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.529792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:54.537552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e17bd9bf-7e01-4f23-b0aa-e4e0c0b76cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091944 Jun 17 13:14:54.538117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1076/2059] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:54.602576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-69bd73af-9c7d-48bd-b1c8-7a8c416d349c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:54.603822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-69bd73af-9c7d-48bd-b1c8-7a8c416d349c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:54.610490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69bd73af-9c7d-48bd-b1c8-7a8c416d349c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.610932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69bd73af-9c7d-48bd-b1c8-7a8c416d349c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.611730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69bd73af-9c7d-48bd-b1c8-7a8c416d349c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.612162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69bd73af-9c7d-48bd-b1c8-7a8c416d349c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.644258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-69bd73af-9c7d-48bd-b1c8-7a8c416d349c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Jun 17 13:14:54.644816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 984/2060] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:54 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:55.181281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4c3b0e9-eff0-4498-a58a-1cc4ffa6d61f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:55.182361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4c3b0e9-eff0-4498-a58a-1cc4ffa6d61f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:55.189695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c3b0e9-eff0-4498-a58a-1cc4ffa6d61f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.190296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c3b0e9-eff0-4498-a58a-1cc4ffa6d61f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.191169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c3b0e9-eff0-4498-a58a-1cc4ffa6d61f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.191712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4c3b0e9-eff0-4498-a58a-1cc4ffa6d61f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.225582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4c3b0e9-eff0-4498-a58a-1cc4ffa6d61f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048849 Jun 17 13:14:55.226128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1077/2061] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:55 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:55.555011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:55.555658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:55.562930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.563396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.564173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.564605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.627742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:55.635806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a036ae1-b912-40e2-8198-c5ded598ab75 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084661 Jun 17 13:14:55.636390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 985/2062] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:55.656573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-28efe369-05ee-41e6-ae1d-673bc33a407e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:55.657492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-28efe369-05ee-41e6-ae1d-673bc33a407e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:55.664276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28efe369-05ee-41e6-ae1d-673bc33a407e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.664724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28efe369-05ee-41e6-ae1d-673bc33a407e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.665508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28efe369-05ee-41e6-ae1d-673bc33a407e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.665968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28efe369-05ee-41e6-ae1d-673bc33a407e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.690607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:55.695085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-28efe369-05ee-41e6-ae1d-673bc33a407e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Jun 17 13:14:55.695771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1078/2063] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:56.238413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbf038d4-db71-49b8-87b0-326e85e9b790 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:56.239621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cbf038d4-db71-49b8-87b0-326e85e9b790 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:56.248762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbf038d4-db71-49b8-87b0-326e85e9b790 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.249212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbf038d4-db71-49b8-87b0-326e85e9b790 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.250093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbf038d4-db71-49b8-87b0-326e85e9b790 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.250522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbf038d4-db71-49b8-87b0-326e85e9b790 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.254853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:56.282680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cbf038d4-db71-49b8-87b0-326e85e9b790 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Jun 17 13:14:56.283413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 986/2064] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:56.654850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:56.655519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:56.662823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.663462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.664093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.664525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.710169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bfbb92a0-c1db-45d1-85b5-b5c06c34e32c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:56.711193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bfbb92a0-c1db-45d1-85b5-b5c06c34e32c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:56.719282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfbb92a0-c1db-45d1-85b5-b5c06c34e32c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.719765 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfbb92a0-c1db-45d1-85b5-b5c06c34e32c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.720525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfbb92a0-c1db-45d1-85b5-b5c06c34e32c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.720947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bfbb92a0-c1db-45d1-85b5-b5c06c34e32c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.731978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:56.740300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98a2c048-0a06-407b-b1d7-a619d7d83b12 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089878 Jun 17 13:14:56.741546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1079/2065] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:56.754744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bfbb92a0-c1db-45d1-85b5-b5c06c34e32c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049766 Jun 17 13:14:56.755471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 987/2066] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:56 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:57.299066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-804b61ff-93d5-48a2-b42c-01571aed2604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:57.300640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-804b61ff-93d5-48a2-b42c-01571aed2604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:57.309666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804b61ff-93d5-48a2-b42c-01571aed2604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.310100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804b61ff-93d5-48a2-b42c-01571aed2604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.310841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804b61ff-93d5-48a2-b42c-01571aed2604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.311265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-804b61ff-93d5-48a2-b42c-01571aed2604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.342393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-804b61ff-93d5-48a2-b42c-01571aed2604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049960 Jun 17 13:14:57.342946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1080/2067] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:57.758307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:57.758897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:57.766093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.766513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.767302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.767764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.768233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3b4f22b1-172e-4d53-bb66-a2a817066718 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:57.769161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3b4f22b1-172e-4d53-bb66-a2a817066718 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:57.776036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4f22b1-172e-4d53-bb66-a2a817066718 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.776483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4f22b1-172e-4d53-bb66-a2a817066718 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.777453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4f22b1-172e-4d53-bb66-a2a817066718 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.778049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b4f22b1-172e-4d53-bb66-a2a817066718 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.809030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3b4f22b1-172e-4d53-bb66-a2a817066718 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Jun 17 13:14:57.809571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1081/2068] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:57 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:57.837289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:57.845081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62e8167b-b31d-4512-9623-4e9a67da8065 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090685 Jun 17 13:14:57.845656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 988/2069] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:58.354921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-97be9b63-5441-4967-bc13-e6053138459a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:58.355872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-97be9b63-5441-4967-bc13-e6053138459a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:58.362618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97be9b63-5441-4967-bc13-e6053138459a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.363081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97be9b63-5441-4967-bc13-e6053138459a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.363877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97be9b63-5441-4967-bc13-e6053138459a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.364311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-97be9b63-5441-4967-bc13-e6053138459a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.395079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-97be9b63-5441-4967-bc13-e6053138459a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Jun 17 13:14:58.395584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1082/2070] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:58.824141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-57be8eb3-6dd8-454a-b027-78a99798a710 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:58.825413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-57be8eb3-6dd8-454a-b027-78a99798a710 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:58.836198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57be8eb3-6dd8-454a-b027-78a99798a710 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.836824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57be8eb3-6dd8-454a-b027-78a99798a710 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.837984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57be8eb3-6dd8-454a-b027-78a99798a710 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.838642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57be8eb3-6dd8-454a-b027-78a99798a710 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.866206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:58.866764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:58.870564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-57be8eb3-6dd8-454a-b027-78a99798a710 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053034 Jun 17 13:14:58.871175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 989/2071] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:58 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:58.874239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.874678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.875489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.875918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.948697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:58.956741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-74f03834-f73c-4dfa-8842-88571e1aecb4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098494 Jun 17 13:14:58.957305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1083/2072] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:14:59.406834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1a0f1fb-bd91-42d0-b085-df3bba0b57cd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:59.407697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1a0f1fb-bd91-42d0-b085-df3bba0b57cd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:59.414060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1a0f1fb-bd91-42d0-b085-df3bba0b57cd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.414505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1a0f1fb-bd91-42d0-b085-df3bba0b57cd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.415262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1a0f1fb-bd91-42d0-b085-df3bba0b57cd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.415751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1a0f1fb-bd91-42d0-b085-df3bba0b57cd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.445359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1a0f1fb-bd91-42d0-b085-df3bba0b57cd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042795 Jun 17 13:14:59.445923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 990/2073] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:59.882508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f98cb995-8c7f-45d0-a746-204d865ad744 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:59.883424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f98cb995-8c7f-45d0-a746-204d865ad744 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:59.890551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98cb995-8c7f-45d0-a746-204d865ad744 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.890992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98cb995-8c7f-45d0-a746-204d865ad744 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.891808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98cb995-8c7f-45d0-a746-204d865ad744 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.892207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98cb995-8c7f-45d0-a746-204d865ad744 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.921385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f98cb995-8c7f-45d0-a746-204d865ad744 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Jun 17 13:14:59.922103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1084/2074] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:59 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:59.973347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:59.974038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:59.980884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.981329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.982121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.982552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.047159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:00.055659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5f0ac60d-37cd-40b1-a3c0-bbb4ba2db38b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086262 Jun 17 13:15:00.056309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 991/2075] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:59 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:00.355728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:15:00.356036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:15:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:15:00.458077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81d63c42-de08-4dd0-962c-9a209051fc4c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:00.458902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81d63c42-de08-4dd0-962c-9a209051fc4c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:00.465473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81d63c42-de08-4dd0-962c-9a209051fc4c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.465923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81d63c42-de08-4dd0-962c-9a209051fc4c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.466689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81d63c42-de08-4dd0-962c-9a209051fc4c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.467121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81d63c42-de08-4dd0-962c-9a209051fc4c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.498530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81d63c42-de08-4dd0-962c-9a209051fc4c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Jun 17 13:15:00.499095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1085/2076] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:00.933120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d0669cf5-238a-4ad0-9ca7-a2769099d490 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:00.934046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d0669cf5-238a-4ad0-9ca7-a2769099d490 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:00.940866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0669cf5-238a-4ad0-9ca7-a2769099d490 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.941322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0669cf5-238a-4ad0-9ca7-a2769099d490 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.942086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0669cf5-238a-4ad0-9ca7-a2769099d490 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.942518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0669cf5-238a-4ad0-9ca7-a2769099d490 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.972156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d0669cf5-238a-4ad0-9ca7-a2769099d490 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043044 Jun 17 13:15:00.972673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 992/2077] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:01.073388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:01.074011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:01.081015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.081457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.082204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.082657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.145443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:01.153426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0a5b5617-ba66-499f-b7f3-774ba7b59bb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084089 Jun 17 13:15:01.154126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1086/2078] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:01.510552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48946453-b9ba-412c-83fd-d48ac552146e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:01.511469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48946453-b9ba-412c-83fd-d48ac552146e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:01.518528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48946453-b9ba-412c-83fd-d48ac552146e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.518970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48946453-b9ba-412c-83fd-d48ac552146e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.519756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48946453-b9ba-412c-83fd-d48ac552146e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.520184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48946453-b9ba-412c-83fd-d48ac552146e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.552896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48946453-b9ba-412c-83fd-d48ac552146e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046275 Jun 17 13:15:01.553449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 993/2079] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:01.986611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d565a188-a30a-4b2c-a5ef-282609f57fed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:01.987566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d565a188-a30a-4b2c-a5ef-282609f57fed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:01.989485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=88 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:01.999111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d565a188-a30a-4b2c-a5ef-282609f57fed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.999585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d565a188-a30a-4b2c-a5ef-282609f57fed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.004655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d565a188-a30a-4b2c-a5ef-282609f57fed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.005094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d565a188-a30a-4b2c-a5ef-282609f57fed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.041947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d565a188-a30a-4b2c-a5ef-282609f57fed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061810 Jun 17 13:15:02.042486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1087/2080] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:02.171211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:02.172127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:02.178559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.179012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.179811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.180242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.247489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:02.256046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-50bc74ca-7b64-4999-b786-3f499df56d78 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088885 Jun 17 13:15:02.256615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 994/2081] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:02.565428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aa2dda6b-bf89-4270-b69c-1fb5e2f9fae4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:02.566384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aa2dda6b-bf89-4270-b69c-1fb5e2f9fae4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:02.573391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa2dda6b-bf89-4270-b69c-1fb5e2f9fae4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.573837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa2dda6b-bf89-4270-b69c-1fb5e2f9fae4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.574602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa2dda6b-bf89-4270-b69c-1fb5e2f9fae4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.575034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa2dda6b-bf89-4270-b69c-1fb5e2f9fae4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.605374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aa2dda6b-bf89-4270-b69c-1fb5e2f9fae4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Jun 17 13:15:02.605951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1088/2082] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:02 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:03.054589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-879c7783-eae3-4d7c-a1a1-1aa3eb959596 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:03.055558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-879c7783-eae3-4d7c-a1a1-1aa3eb959596 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:03.063031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-879c7783-eae3-4d7c-a1a1-1aa3eb959596 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.063513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-879c7783-eae3-4d7c-a1a1-1aa3eb959596 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.064287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-879c7783-eae3-4d7c-a1a1-1aa3eb959596 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.064722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-879c7783-eae3-4d7c-a1a1-1aa3eb959596 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.095587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-879c7783-eae3-4d7c-a1a1-1aa3eb959596 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Jun 17 13:15:03.096054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 995/2083] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:03.274065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:03.274671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:03.281689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.282118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.282893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.283328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.348569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:03.356801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6a14c7b3-9dbf-4770-83ee-f4090022f1f9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086652 Jun 17 13:15:03.357364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1089/2084] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:03.618284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c70f24f1-9051-492b-b22b-a38ae22acbe1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:03.619255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c70f24f1-9051-492b-b22b-a38ae22acbe1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:03.626542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c70f24f1-9051-492b-b22b-a38ae22acbe1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.626992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c70f24f1-9051-492b-b22b-a38ae22acbe1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.627844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c70f24f1-9051-492b-b22b-a38ae22acbe1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.628274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c70f24f1-9051-492b-b22b-a38ae22acbe1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.659959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c70f24f1-9051-492b-b22b-a38ae22acbe1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Jun 17 13:15:03.660504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 996/2085] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:04.036535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:15:04.037172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:15:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:15:04.107859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-530883a9-15ac-4986-9397-b3027a36112d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:04.108988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-530883a9-15ac-4986-9397-b3027a36112d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:04.116325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-530883a9-15ac-4986-9397-b3027a36112d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.117570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-530883a9-15ac-4986-9397-b3027a36112d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.117570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-530883a9-15ac-4986-9397-b3027a36112d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.117961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-530883a9-15ac-4986-9397-b3027a36112d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.149622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-530883a9-15ac-4986-9397-b3027a36112d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045905 Jun 17 13:15:04.150176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1090/2086] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:04.374886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:04.375506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:04.382897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.383345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.384211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.384726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.447797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:04.455985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-64cf3df2-f1e1-43c8-84d5-d1c58ddc4603 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085315 Jun 17 13:15:04.456549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 997/2087] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:04.672433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9af2f607-6723-4db0-9718-c68b1f9af82d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:04.673270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9af2f607-6723-4db0-9718-c68b1f9af82d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:04.679885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af2f607-6723-4db0-9718-c68b1f9af82d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.680330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af2f607-6723-4db0-9718-c68b1f9af82d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.681092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af2f607-6723-4db0-9718-c68b1f9af82d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.681525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9af2f607-6723-4db0-9718-c68b1f9af82d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.710793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9af2f607-6723-4db0-9718-c68b1f9af82d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Jun 17 13:15:04.711405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1091/2088] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:05.161990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-66fe96b7-648d-4ee0-b377-d935a4971ed3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:05.162963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-66fe96b7-648d-4ee0-b377-d935a4971ed3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:05.169648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe96b7-648d-4ee0-b377-d935a4971ed3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.170099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe96b7-648d-4ee0-b377-d935a4971ed3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.170999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe96b7-648d-4ee0-b377-d935a4971ed3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.171669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66fe96b7-648d-4ee0-b377-d935a4971ed3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.202189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-66fe96b7-648d-4ee0-b377-d935a4971ed3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Jun 17 13:15:05.202738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 998/2089] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:05.473013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:05.473667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:05.480735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.481218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.481978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.482413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.546492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:05.554632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1daf33a-0e71-4e30-aca2-1c8d0618ac06 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085623 Jun 17 13:15:05.555189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1092/2090] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:05.723412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-26806bc3-4a08-47d1-93bd-a83448acefbf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:05.724245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-26806bc3-4a08-47d1-93bd-a83448acefbf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:05.731562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26806bc3-4a08-47d1-93bd-a83448acefbf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.732010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26806bc3-4a08-47d1-93bd-a83448acefbf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.732783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26806bc3-4a08-47d1-93bd-a83448acefbf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.733236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26806bc3-4a08-47d1-93bd-a83448acefbf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.765174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-26806bc3-4a08-47d1-93bd-a83448acefbf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045938 Jun 17 13:15:05.765824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 999/2091] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:05 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:06.216833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-67e0141d-76cf-4689-ad38-e2e440a6033b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:06.218021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-67e0141d-76cf-4689-ad38-e2e440a6033b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:06.228109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67e0141d-76cf-4689-ad38-e2e440a6033b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.228571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67e0141d-76cf-4689-ad38-e2e440a6033b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.229348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67e0141d-76cf-4689-ad38-e2e440a6033b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.229782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67e0141d-76cf-4689-ad38-e2e440a6033b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.262226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-67e0141d-76cf-4689-ad38-e2e440a6033b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050957 Jun 17 13:15:06.262798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1093/2092] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:06.572598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:06.573191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:06.580261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.580704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.581476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.581901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.651889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:06.660603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b2003d03-b2d9-46b9-ba49-a68408f65181 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091958 Jun 17 13:15:06.661168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1000/2093] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:06.777580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-52425a89-1ca9-45f3-b7a5-2364419d583b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:06.778531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-52425a89-1ca9-45f3-b7a5-2364419d583b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:06.786049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52425a89-1ca9-45f3-b7a5-2364419d583b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.786543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52425a89-1ca9-45f3-b7a5-2364419d583b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.787352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52425a89-1ca9-45f3-b7a5-2364419d583b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.787944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-52425a89-1ca9-45f3-b7a5-2364419d583b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.819505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-52425a89-1ca9-45f3-b7a5-2364419d583b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Jun 17 13:15:06.820107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1094/2094] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:06 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:07.274975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-10ce5dc7-172c-4069-808d-9edf82428a5f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:07.275947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-10ce5dc7-172c-4069-808d-9edf82428a5f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:07.282975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10ce5dc7-172c-4069-808d-9edf82428a5f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.283502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10ce5dc7-172c-4069-808d-9edf82428a5f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.284276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10ce5dc7-172c-4069-808d-9edf82428a5f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.284730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10ce5dc7-172c-4069-808d-9edf82428a5f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.319417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-10ce5dc7-172c-4069-808d-9edf82428a5f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Jun 17 13:15:07.320039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1001/2095] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:07 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:07.677917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:07.678521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:07.685109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.685557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.686415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.686949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.705088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:07.752608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:07.760556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3eade060-7316-47a8-bb8e-f9aab961c9c1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086600 Jun 17 13:15:07.761118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1095/2096] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:07.833986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbddf6a7-852c-4798-be3b-0d31253bf099 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:07.834938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cbddf6a7-852c-4798-be3b-0d31253bf099 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:07.841690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbddf6a7-852c-4798-be3b-0d31253bf099 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.842132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbddf6a7-852c-4798-be3b-0d31253bf099 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.842980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbddf6a7-852c-4798-be3b-0d31253bf099 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.843512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbddf6a7-852c-4798-be3b-0d31253bf099 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.879278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:07.884246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cbddf6a7-852c-4798-be3b-0d31253bf099 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055098 Jun 17 13:15:07.884807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1002/2097] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:07 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:08.331992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b43eaf4-a364-4f40-8cf4-2786802fc367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:08.332921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b43eaf4-a364-4f40-8cf4-2786802fc367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:08.340049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b43eaf4-a364-4f40-8cf4-2786802fc367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.340494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b43eaf4-a364-4f40-8cf4-2786802fc367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.341256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b43eaf4-a364-4f40-8cf4-2786802fc367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.341687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b43eaf4-a364-4f40-8cf4-2786802fc367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.373040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b43eaf4-a364-4f40-8cf4-2786802fc367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 Jun 17 13:15:08.373587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1096/2098] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:08.781249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:08.781859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:08.784027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=84 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:08.789713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.790162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.790904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.791327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.855291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:08.863469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d48cee4a-890b-46f9-8651-e737588895fc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086438 Jun 17 13:15:08.864007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1003/2099] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:08.896701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3f6836d5-218d-4525-bdde-5b27a7bf6ac5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:08.897854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3f6836d5-218d-4525-bdde-5b27a7bf6ac5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:08.905090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6836d5-218d-4525-bdde-5b27a7bf6ac5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.905537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6836d5-218d-4525-bdde-5b27a7bf6ac5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.906703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6836d5-218d-4525-bdde-5b27a7bf6ac5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.907151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f6836d5-218d-4525-bdde-5b27a7bf6ac5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.938620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3f6836d5-218d-4525-bdde-5b27a7bf6ac5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046010 Jun 17 13:15:08.939151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1097/2100] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:08 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:09.385157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6f1f1ba-9bce-43ca-85bc-d6071e1c8a27 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:09.386010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6f1f1ba-9bce-43ca-85bc-d6071e1c8a27 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:09.392750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6f1f1ba-9bce-43ca-85bc-d6071e1c8a27 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.393191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6f1f1ba-9bce-43ca-85bc-d6071e1c8a27 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.393951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6f1f1ba-9bce-43ca-85bc-d6071e1c8a27 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.394382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6f1f1ba-9bce-43ca-85bc-d6071e1c8a27 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.425120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6f1f1ba-9bce-43ca-85bc-d6071e1c8a27 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Jun 17 13:15:09.425687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1004/2101] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:09.880897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:09.881484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:09.888602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.889045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.889824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.890249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.952090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4a9f16b-0dc4-428f-9fa3-e634955de9ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:09.953403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:09.953556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b4a9f16b-0dc4-428f-9fa3-e634955de9ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:09.963845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a9f16b-0dc4-428f-9fa3-e634955de9ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.964556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a9f16b-0dc4-428f-9fa3-e634955de9ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.965833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a9f16b-0dc4-428f-9fa3-e634955de9ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.966000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2a19fd62-0925-46d2-845a-ee32ecbd63fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088749 Jun 17 13:15:09.966539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a9f16b-0dc4-428f-9fa3-e634955de9ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.966988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1098/2102] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:09 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:10.004606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b4a9f16b-0dc4-428f-9fa3-e634955de9ea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058002 Jun 17 13:15:10.005158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1005/2103] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:09 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:10.437661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c96938c-2d81-474f-a6cb-a998b3126309 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:10.438621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c96938c-2d81-474f-a6cb-a998b3126309 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:10.444946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c96938c-2d81-474f-a6cb-a998b3126309 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:10.445394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c96938c-2d81-474f-a6cb-a998b3126309 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:10.446152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c96938c-2d81-474f-a6cb-a998b3126309 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:10.446584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c96938c-2d81-474f-a6cb-a998b3126309 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:10.476530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c96938c-2d81-474f-a6cb-a998b3126309 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Jun 17 13:15:10.477063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1099/2104] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:10.991813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:10.992468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:10.999566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.000043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.000812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.001608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.016632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6c49e900-b5a6-455a-961e-6e845ce4b071 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:11.017680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6c49e900-b5a6-455a-961e-6e845ce4b071 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:11.024739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c49e900-b5a6-455a-961e-6e845ce4b071 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.025185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c49e900-b5a6-455a-961e-6e845ce4b071 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.025976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c49e900-b5a6-455a-961e-6e845ce4b071 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.026407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c49e900-b5a6-455a-961e-6e845ce4b071 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.058525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6c49e900-b5a6-455a-961e-6e845ce4b071 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Jun 17 13:15:11.059077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1100/2105] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:11 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:11.070054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:11.078496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-18e97d8e-b7ed-43e5-9918-17284a2ce429 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090690 Jun 17 13:15:11.079056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1006/2106] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:10 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:11.488747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e8823bb7-a67d-494e-940b-22c39c59a434 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:11.489588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e8823bb7-a67d-494e-940b-22c39c59a434 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:11.496099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8823bb7-a67d-494e-940b-22c39c59a434 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.496537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8823bb7-a67d-494e-940b-22c39c59a434 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.497284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8823bb7-a67d-494e-940b-22c39c59a434 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.497695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8823bb7-a67d-494e-940b-22c39c59a434 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.538622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e8823bb7-a67d-494e-940b-22c39c59a434 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053927 Jun 17 13:15:11.539192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1101/2107] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:12.070615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-001d6368-9c2d-4545-abc9-7ceff20fbd3d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:12.071569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-001d6368-9c2d-4545-abc9-7ceff20fbd3d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:12.078670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-001d6368-9c2d-4545-abc9-7ceff20fbd3d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.079110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-001d6368-9c2d-4545-abc9-7ceff20fbd3d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.079872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-001d6368-9c2d-4545-abc9-7ceff20fbd3d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.080317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-001d6368-9c2d-4545-abc9-7ceff20fbd3d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.096110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:12.096756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:12.103560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.104001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.104733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.105186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.110279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-001d6368-9c2d-4545-abc9-7ceff20fbd3d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Jun 17 13:15:12.114687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1007/2108] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:12 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:12.168301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:12.176138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c685f2c1-a23a-41c0-bcb8-f41bd8d7b4a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084519 Jun 17 13:15:12.176690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1102/2109] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:12.550782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aba674dc-ce3d-4adb-ab8e-6f2973015cf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:12.551734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aba674dc-ce3d-4adb-ab8e-6f2973015cf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:12.558295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aba674dc-ce3d-4adb-ab8e-6f2973015cf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.558716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aba674dc-ce3d-4adb-ab8e-6f2973015cf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.559532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aba674dc-ce3d-4adb-ab8e-6f2973015cf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.559963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aba674dc-ce3d-4adb-ab8e-6f2973015cf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.590905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aba674dc-ce3d-4adb-ab8e-6f2973015cf4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Jun 17 13:15:12.591460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1008/2110] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:13.122665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ce2fa80-3767-45b1-89a3-114fc9525ea4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:13.123871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ce2fa80-3767-45b1-89a3-114fc9525ea4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:13.131256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ce2fa80-3767-45b1-89a3-114fc9525ea4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.131715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ce2fa80-3767-45b1-89a3-114fc9525ea4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.132503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ce2fa80-3767-45b1-89a3-114fc9525ea4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.132931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ce2fa80-3767-45b1-89a3-114fc9525ea4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.163352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ce2fa80-3767-45b1-89a3-114fc9525ea4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Jun 17 13:15:13.163868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1103/2111] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:13.193242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:13.193831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:13.200787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.201233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.202156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.202624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.266304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:13.274120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d10ba393-7f13-4b12-a398-4f1de34edfad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084798 Jun 17 13:15:13.274663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1009/2112] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:13.603011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d5502b94-fa88-4c5a-b548-88a12493259b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:13.603950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d5502b94-fa88-4c5a-b548-88a12493259b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:13.610748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5502b94-fa88-4c5a-b548-88a12493259b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.611194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5502b94-fa88-4c5a-b548-88a12493259b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.611967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5502b94-fa88-4c5a-b548-88a12493259b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.612395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d5502b94-fa88-4c5a-b548-88a12493259b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.643633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d5502b94-fa88-4c5a-b548-88a12493259b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Jun 17 13:15:13.644163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1104/2113] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:14.176283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ec3fa353-1c97-4e51-bec3-56ea524481bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:14.177198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ec3fa353-1c97-4e51-bec3-56ea524481bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:14.183892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3fa353-1c97-4e51-bec3-56ea524481bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.184362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3fa353-1c97-4e51-bec3-56ea524481bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.185138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3fa353-1c97-4e51-bec3-56ea524481bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.185568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3fa353-1c97-4e51-bec3-56ea524481bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.216138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ec3fa353-1c97-4e51-bec3-56ea524481bf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Jun 17 13:15:14.216849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1010/2114] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:14 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:14.291364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:14.292012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:14.298919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.299341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.300128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.300552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.368628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:14.377254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6c62c394-753e-4cf5-b6b6-127a1945b765 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089748 Jun 17 13:15:14.377827 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1105/2115] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:14.655809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1d625849-484c-4799-bd89-99216e617aea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:14.656658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1d625849-484c-4799-bd89-99216e617aea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:14.663259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d625849-484c-4799-bd89-99216e617aea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.663771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d625849-484c-4799-bd89-99216e617aea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.664527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d625849-484c-4799-bd89-99216e617aea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.664958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d625849-484c-4799-bd89-99216e617aea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.695639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1d625849-484c-4799-bd89-99216e617aea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Jun 17 13:15:14.696207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1011/2116] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:15.228292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49fd1b7e-7964-40c8-875c-ff0dea129c43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:15.229214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49fd1b7e-7964-40c8-875c-ff0dea129c43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:15.236000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49fd1b7e-7964-40c8-875c-ff0dea129c43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.236454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49fd1b7e-7964-40c8-875c-ff0dea129c43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.237212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49fd1b7e-7964-40c8-875c-ff0dea129c43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.237643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49fd1b7e-7964-40c8-875c-ff0dea129c43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.270162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49fd1b7e-7964-40c8-875c-ff0dea129c43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Jun 17 13:15:15.270771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1106/2117] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:15 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:15.395612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:15.396268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:15.402592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.403032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.403824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.404251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.468169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:15.475952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-98f268d7-695b-4659-9fdf-311841af4675 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085092 Jun 17 13:15:15.476551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1012/2118] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:15.708164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eeb6cefc-4003-4c6e-9d46-4f2f97070f2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:15.708997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eeb6cefc-4003-4c6e-9d46-4f2f97070f2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:15.716221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eeb6cefc-4003-4c6e-9d46-4f2f97070f2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.716671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eeb6cefc-4003-4c6e-9d46-4f2f97070f2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.717521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eeb6cefc-4003-4c6e-9d46-4f2f97070f2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.717964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eeb6cefc-4003-4c6e-9d46-4f2f97070f2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.748608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eeb6cefc-4003-4c6e-9d46-4f2f97070f2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044640 Jun 17 13:15:15.749496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1107/2119] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:16.283097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5c22aac-bd8b-46a2-b7bd-c53d3c268335 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:16.284048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5c22aac-bd8b-46a2-b7bd-c53d3c268335 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:16.290770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c22aac-bd8b-46a2-b7bd-c53d3c268335 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.291220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c22aac-bd8b-46a2-b7bd-c53d3c268335 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.292026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c22aac-bd8b-46a2-b7bd-c53d3c268335 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.292462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5c22aac-bd8b-46a2-b7bd-c53d3c268335 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.324976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5c22aac-bd8b-46a2-b7bd-c53d3c268335 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046608 Jun 17 13:15:16.325546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1013/2120] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:16 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:16.493407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:16.494004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:16.500641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.501441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.502197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.502617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.567851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:16.575398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f753f5f0-995d-4633-9c90-d16aed5514a0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085909 Jun 17 13:15:16.575935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1108/2121] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:16.761004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6554f74e-dc7a-462f-b47d-5e1905a627a6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:16.761878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6554f74e-dc7a-462f-b47d-5e1905a627a6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:16.769746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6554f74e-dc7a-462f-b47d-5e1905a627a6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.770181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6554f74e-dc7a-462f-b47d-5e1905a627a6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.770929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6554f74e-dc7a-462f-b47d-5e1905a627a6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.771347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6554f74e-dc7a-462f-b47d-5e1905a627a6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.803047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6554f74e-dc7a-462f-b47d-5e1905a627a6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Jun 17 13:15:16.803639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1014/2122] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:17.337612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-226f8ecc-9138-4a06-b851-8983544f85d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:17.338512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-226f8ecc-9138-4a06-b851-8983544f85d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:17.346640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-226f8ecc-9138-4a06-b851-8983544f85d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.347053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-226f8ecc-9138-4a06-b851-8983544f85d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.348039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-226f8ecc-9138-4a06-b851-8983544f85d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.348665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-226f8ecc-9138-4a06-b851-8983544f85d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.382569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-226f8ecc-9138-4a06-b851-8983544f85d6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Jun 17 13:15:17.383040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1109/2123] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:17.592681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:17.593280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:17.599871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.600308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.601101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.601528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.665107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:17.674272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c1ad2688-8261-4942-b577-83972addb43c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085787 Jun 17 13:15:17.674907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1015/2124] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:17.816330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-86894784-9abd-4f9b-b402-a404fb93cf6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:17.817305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-86894784-9abd-4f9b-b402-a404fb93cf6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:17.823921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86894784-9abd-4f9b-b402-a404fb93cf6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.824368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86894784-9abd-4f9b-b402-a404fb93cf6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.825137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86894784-9abd-4f9b-b402-a404fb93cf6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.825567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86894784-9abd-4f9b-b402-a404fb93cf6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.856643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-86894784-9abd-4f9b-b402-a404fb93cf6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Jun 17 13:15:17.857215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1110/2125] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:18.394972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5e3e410c-febb-491b-8d93-c71b883bf53a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:18.395929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5e3e410c-febb-491b-8d93-c71b883bf53a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:18.402930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e3e410c-febb-491b-8d93-c71b883bf53a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.403390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e3e410c-febb-491b-8d93-c71b883bf53a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.404154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e3e410c-febb-491b-8d93-c71b883bf53a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.404576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e3e410c-febb-491b-8d93-c71b883bf53a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.435471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5e3e410c-febb-491b-8d93-c71b883bf53a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Jun 17 13:15:18.436353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1016/2126] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:18 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:18.698163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:18.698951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:18.705901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.706482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.707237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.707707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.776051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:18.786050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1847a6a-cf78-46c3-a24a-630e808e3827 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093166 Jun 17 13:15:18.786617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1111/2127] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:18.870371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d9828bcd-ef94-42c7-8de4-4a06f520754a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:18.871357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d9828bcd-ef94-42c7-8de4-4a06f520754a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:18.878590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9828bcd-ef94-42c7-8de4-4a06f520754a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.879099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9828bcd-ef94-42c7-8de4-4a06f520754a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.880389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9828bcd-ef94-42c7-8de4-4a06f520754a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.881059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9828bcd-ef94-42c7-8de4-4a06f520754a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.920142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d9828bcd-ef94-42c7-8de4-4a06f520754a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053833 Jun 17 13:15:18.920838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1017/2128] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:19.449454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-343fc0f8-06a8-4ed3-88c7-a98ea2ee7baf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:19.450292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-343fc0f8-06a8-4ed3-88c7-a98ea2ee7baf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:19.458822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-343fc0f8-06a8-4ed3-88c7-a98ea2ee7baf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.459274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-343fc0f8-06a8-4ed3-88c7-a98ea2ee7baf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.460148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-343fc0f8-06a8-4ed3-88c7-a98ea2ee7baf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.460582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-343fc0f8-06a8-4ed3-88c7-a98ea2ee7baf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.469683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:19.497443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-343fc0f8-06a8-4ed3-88c7-a98ea2ee7baf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053387 Jun 17 13:15:19.498067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1112/2129] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:19 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:19.803983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:19.804658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:19.811863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.812303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.813081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.813502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.883266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:19.891624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-77845d3f-cc8b-4637-8544-5cd8f79df1b7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091495 Jun 17 13:15:19.892191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1018/2130] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:19.932542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eb83aade-e9a3-43f9-9530-c5de64f7a21a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:19.933428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eb83aade-e9a3-43f9-9530-c5de64f7a21a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:19.940650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83aade-e9a3-43f9-9530-c5de64f7a21a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.941084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83aade-e9a3-43f9-9530-c5de64f7a21a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.941830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83aade-e9a3-43f9-9530-c5de64f7a21a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.942256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb83aade-e9a3-43f9-9530-c5de64f7a21a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.972509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eb83aade-e9a3-43f9-9530-c5de64f7a21a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Jun 17 13:15:19.973046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1113/2131] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:20.410089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:15:20.410089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:15:20.510528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d44e0f26-a873-49e7-81a1-2c8fc25e6b1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:20.511484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d44e0f26-a873-49e7-81a1-2c8fc25e6b1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:20.518304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44e0f26-a873-49e7-81a1-2c8fc25e6b1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.518748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44e0f26-a873-49e7-81a1-2c8fc25e6b1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.519546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44e0f26-a873-49e7-81a1-2c8fc25e6b1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.519981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44e0f26-a873-49e7-81a1-2c8fc25e6b1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.537358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:20.552438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d44e0f26-a873-49e7-81a1-2c8fc25e6b1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Jun 17 13:15:20.552982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1019/2132] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:20 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:20.908852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:20.909440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:20.916024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.916459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.917205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.917627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.979797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:20.984421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cdd41dc4-8745-4ebb-b3d5-9a0acab1d7ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:20.985357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cdd41dc4-8745-4ebb-b3d5-9a0acab1d7ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:20.987956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f440f841-1432-42c5-84de-088f641f0787 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083041 Jun 17 13:15:20.988787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1114/2133] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:20 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:20.992598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd41dc4-8745-4ebb-b3d5-9a0acab1d7ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.993048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd41dc4-8745-4ebb-b3d5-9a0acab1d7ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.993828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd41dc4-8745-4ebb-b3d5-9a0acab1d7ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.994262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd41dc4-8745-4ebb-b3d5-9a0acab1d7ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.025559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cdd41dc4-8745-4ebb-b3d5-9a0acab1d7ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Jun 17 13:15:21.026125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1020/2134] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:21.564209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0644e406-1daf-4ec4-b6c8-ed85c0d32c9a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:21.565126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0644e406-1daf-4ec4-b6c8-ed85c0d32c9a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:21.571675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0644e406-1daf-4ec4-b6c8-ed85c0d32c9a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.572114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0644e406-1daf-4ec4-b6c8-ed85c0d32c9a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.572862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0644e406-1daf-4ec4-b6c8-ed85c0d32c9a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.573256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0644e406-1daf-4ec4-b6c8-ed85c0d32c9a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.603700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0644e406-1daf-4ec4-b6c8-ed85c0d32c9a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Jun 17 13:15:21.604236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1115/2135] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:22.006002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:22.006662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:22.013779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.014337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.015252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.015746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.037631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3fea9af9-3f32-481e-9c46-a6aabbb4fd3a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:22.038616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3fea9af9-3f32-481e-9c46-a6aabbb4fd3a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:22.045927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fea9af9-3f32-481e-9c46-a6aabbb4fd3a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.046617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fea9af9-3f32-481e-9c46-a6aabbb4fd3a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.047623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fea9af9-3f32-481e-9c46-a6aabbb4fd3a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.048195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fea9af9-3f32-481e-9c46-a6aabbb4fd3a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.081080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:22.084260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3fea9af9-3f32-481e-9c46-a6aabbb4fd3a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050659 Jun 17 13:15:22.085170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1116/2136] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:22.091532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-92c09431-162d-4b59-9535-9d9849e64e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089442 Jun 17 13:15:22.092099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1021/2137] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:22.615850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-99830805-2e2f-4a3e-873f-664b5a863062 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:22.616794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-99830805-2e2f-4a3e-873f-664b5a863062 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:22.623315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99830805-2e2f-4a3e-873f-664b5a863062 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.624082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99830805-2e2f-4a3e-873f-664b5a863062 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.624855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99830805-2e2f-4a3e-873f-664b5a863062 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.625287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99830805-2e2f-4a3e-873f-664b5a863062 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.656338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-99830805-2e2f-4a3e-873f-664b5a863062 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Jun 17 13:15:22.656921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1117/2138] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:22 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:23.096433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2a14abce-94fe-4740-ba49-b4770b52c8ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:23.097384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2a14abce-94fe-4740-ba49-b4770b52c8ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:23.104837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a14abce-94fe-4740-ba49-b4770b52c8ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.105286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a14abce-94fe-4740-ba49-b4770b52c8ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.106050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a14abce-94fe-4740-ba49-b4770b52c8ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.106481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a14abce-94fe-4740-ba49-b4770b52c8ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.109403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:23.110305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:23.121016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.121202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.122227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.122781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.139581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2a14abce-94fe-4740-ba49-b4770b52c8ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046743 Jun 17 13:15:23.140478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1022/2139] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:23.188781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:23.197105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3af4f3c9-5ffa-4d31-b706-64d67d6c39ff tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092435 Jun 17 13:15:23.197855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1118/2140] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:23.668621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8fede376-5a4a-42b2-b119-01475357db05 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:23.669453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8fede376-5a4a-42b2-b119-01475357db05 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:23.676138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fede376-5a4a-42b2-b119-01475357db05 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.676583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fede376-5a4a-42b2-b119-01475357db05 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.677348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fede376-5a4a-42b2-b119-01475357db05 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.677778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fede376-5a4a-42b2-b119-01475357db05 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.709610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8fede376-5a4a-42b2-b119-01475357db05 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Jun 17 13:15:23.710168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1023/2141] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:23 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:24.152025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aa3513e1-ecde-4386-bf02-1feabd4cc929 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:24.153025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aa3513e1-ecde-4386-bf02-1feabd4cc929 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:24.160742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa3513e1-ecde-4386-bf02-1feabd4cc929 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.161183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa3513e1-ecde-4386-bf02-1feabd4cc929 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.161942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa3513e1-ecde-4386-bf02-1feabd4cc929 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.162581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aa3513e1-ecde-4386-bf02-1feabd4cc929 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.195497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aa3513e1-ecde-4386-bf02-1feabd4cc929 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047509 Jun 17 13:15:24.196131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1119/2142] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:24.216833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:24.220149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:24.228297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.228743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.229512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.229952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.294193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:24.302065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9a1c4216-db85-4595-87c6-4ed223cce414 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089895 Jun 17 13:15:24.302605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1024/2143] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:24.722218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a9049fdc-efeb-49d8-b11b-2b84f8883593 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:24.723085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a9049fdc-efeb-49d8-b11b-2b84f8883593 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:24.729667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9049fdc-efeb-49d8-b11b-2b84f8883593 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.730105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9049fdc-efeb-49d8-b11b-2b84f8883593 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.730848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9049fdc-efeb-49d8-b11b-2b84f8883593 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.731276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9049fdc-efeb-49d8-b11b-2b84f8883593 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.761486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a9049fdc-efeb-49d8-b11b-2b84f8883593 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043486 Jun 17 13:15:24.762012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1120/2144] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:25.207919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-852ace69-69cc-4608-8e9a-f917939cb794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:25.208857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-852ace69-69cc-4608-8e9a-f917939cb794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:25.215589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-852ace69-69cc-4608-8e9a-f917939cb794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.216047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-852ace69-69cc-4608-8e9a-f917939cb794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.216808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-852ace69-69cc-4608-8e9a-f917939cb794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.217243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-852ace69-69cc-4608-8e9a-f917939cb794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.247076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-852ace69-69cc-4608-8e9a-f917939cb794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Jun 17 13:15:25.247640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1025/2145] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:25 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:25.319919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:25.320500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:25.327765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.328202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.328954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.329372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.395691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:25.403448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-369f35b3-54af-41b3-aa4a-d7881168c408 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087613 Jun 17 13:15:25.404018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1121/2146] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:25.773856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7a286e83-256e-4e28-8ad7-e96ce493641e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:25.774778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7a286e83-256e-4e28-8ad7-e96ce493641e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:25.781482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a286e83-256e-4e28-8ad7-e96ce493641e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.781922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a286e83-256e-4e28-8ad7-e96ce493641e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.782653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a286e83-256e-4e28-8ad7-e96ce493641e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.783074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7a286e83-256e-4e28-8ad7-e96ce493641e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.813315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7a286e83-256e-4e28-8ad7-e96ce493641e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Jun 17 13:15:25.813855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1026/2147] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:25 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:26.259705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-af7fe321-9a0c-4992-8792-f69b4c7d6611 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:26.260658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-af7fe321-9a0c-4992-8792-f69b4c7d6611 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:26.267607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af7fe321-9a0c-4992-8792-f69b4c7d6611 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.268051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af7fe321-9a0c-4992-8792-f69b4c7d6611 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.268874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af7fe321-9a0c-4992-8792-f69b4c7d6611 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.269305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af7fe321-9a0c-4992-8792-f69b4c7d6611 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.299436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-af7fe321-9a0c-4992-8792-f69b4c7d6611 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Jun 17 13:15:26.300022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1122/2148] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:26.421434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:26.422002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:26.429119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.429561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.430315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.430737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.499252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:26.508345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-af77eb0f-3e52-4699-a02a-68d90ab1fac5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091112 Jun 17 13:15:26.508908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1027/2149] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:26.825705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a7a7b35-4bf5-45e1-b3d5-fefe513fa553 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:26.827191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a7a7b35-4bf5-45e1-b3d5-fefe513fa553 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:26.835078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a7a7b35-4bf5-45e1-b3d5-fefe513fa553 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.835518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a7a7b35-4bf5-45e1-b3d5-fefe513fa553 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.836276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a7a7b35-4bf5-45e1-b3d5-fefe513fa553 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.836698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a7a7b35-4bf5-45e1-b3d5-fefe513fa553 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.872908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a7a7b35-4bf5-45e1-b3d5-fefe513fa553 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051343 Jun 17 13:15:26.873890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1123/2150] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:27.310691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2c0723c4-1f49-4dc2-854a-76a854e5e378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:27.311806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2c0723c4-1f49-4dc2-854a-76a854e5e378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:27.318353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0723c4-1f49-4dc2-854a-76a854e5e378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.318793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0723c4-1f49-4dc2-854a-76a854e5e378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.319596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0723c4-1f49-4dc2-854a-76a854e5e378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.320028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c0723c4-1f49-4dc2-854a-76a854e5e378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.350203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2c0723c4-1f49-4dc2-854a-76a854e5e378 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Jun 17 13:15:27.350760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1028/2151] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:27.526618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:27.527253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:27.533984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.534453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.535215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.535678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.598014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:27.605794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eb7a8d3d-a7b2-463f-8abc-291eaf3332d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083409 Jun 17 13:15:27.606402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1124/2152] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:27.885691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ab715d68-e72d-48c2-a1b4-a6cda98cbb08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:27.886603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ab715d68-e72d-48c2-a1b4-a6cda98cbb08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:27.893953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab715d68-e72d-48c2-a1b4-a6cda98cbb08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.894376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab715d68-e72d-48c2-a1b4-a6cda98cbb08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.895152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab715d68-e72d-48c2-a1b4-a6cda98cbb08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.895615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ab715d68-e72d-48c2-a1b4-a6cda98cbb08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.925860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ab715d68-e72d-48c2-a1b4-a6cda98cbb08 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044161 Jun 17 13:15:27.926410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1029/2153] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:28.362779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e9014ef0-8e59-48fb-a042-7127ec10b50c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:28.363732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e9014ef0-8e59-48fb-a042-7127ec10b50c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:28.370896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9014ef0-8e59-48fb-a042-7127ec10b50c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.371255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9014ef0-8e59-48fb-a042-7127ec10b50c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.372092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9014ef0-8e59-48fb-a042-7127ec10b50c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.372523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9014ef0-8e59-48fb-a042-7127ec10b50c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.403035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e9014ef0-8e59-48fb-a042-7127ec10b50c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Jun 17 13:15:28.403654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1125/2154] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:28.623403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:28.624141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:28.631007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.631468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.632231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.632660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.696987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:28.705165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bf344b78-4b33-4697-88c3-4e6ade135a7f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085819 Jun 17 13:15:28.705713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1030/2155] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:28.938296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cc775d62-30dd-4623-84a4-171364381e0a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:28.939161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cc775d62-30dd-4623-84a4-171364381e0a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:28.945616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc775d62-30dd-4623-84a4-171364381e0a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.946053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc775d62-30dd-4623-84a4-171364381e0a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.946794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc775d62-30dd-4623-84a4-171364381e0a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.947199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc775d62-30dd-4623-84a4-171364381e0a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.978214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cc775d62-30dd-4623-84a4-171364381e0a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Jun 17 13:15:28.978808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1126/2156] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:29.414536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd922977-4454-4d64-8e3e-a953248c52c1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:29.415498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd922977-4454-4d64-8e3e-a953248c52c1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:29.422526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd922977-4454-4d64-8e3e-a953248c52c1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.422989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd922977-4454-4d64-8e3e-a953248c52c1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.423776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd922977-4454-4d64-8e3e-a953248c52c1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.424203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd922977-4454-4d64-8e3e-a953248c52c1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.454952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd922977-4454-4d64-8e3e-a953248c52c1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Jun 17 13:15:29.455551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1031/2157] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:29.722626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:29.723231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:29.730169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.730637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.731413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.731864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.953386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:29.961192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d30c9010-d666-42e8-83ca-b4de9d171059 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.242659 Jun 17 13:15:29.961776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1127/2158] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:29.990275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c1cae64d-426a-405f-b84c-5a081bb662fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:29.991126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c1cae64d-426a-405f-b84c-5a081bb662fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:29.997610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1cae64d-426a-405f-b84c-5a081bb662fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.998065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1cae64d-426a-405f-b84c-5a081bb662fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.998839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1cae64d-426a-405f-b84c-5a081bb662fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.999274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1cae64d-426a-405f-b84c-5a081bb662fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.030419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c1cae64d-426a-405f-b84c-5a081bb662fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Jun 17 13:15:30.030988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1032/2159] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:29 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:30.468029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-44379040-c3c5-4194-ae92-62bea7a1656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:30.468999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-44379040-c3c5-4194-ae92-62bea7a1656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:30.475565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44379040-c3c5-4194-ae92-62bea7a1656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.476013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44379040-c3c5-4194-ae92-62bea7a1656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.476772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44379040-c3c5-4194-ae92-62bea7a1656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.477204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44379040-c3c5-4194-ae92-62bea7a1656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.503460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:30.508118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-44379040-c3c5-4194-ae92-62bea7a1656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Jun 17 13:15:30.508674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1128/2160] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:30 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:30.978397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:30.979024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:30.986105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.986596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.987337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.987817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.042635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-19b5d52a-9daf-4e99-ad33-1681f66f82d3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:31.043581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-19b5d52a-9daf-4e99-ad33-1681f66f82d3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:31.050960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19b5d52a-9daf-4e99-ad33-1681f66f82d3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.051428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19b5d52a-9daf-4e99-ad33-1681f66f82d3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.052217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19b5d52a-9daf-4e99-ad33-1681f66f82d3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.052647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19b5d52a-9daf-4e99-ad33-1681f66f82d3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.053494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:31.061959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ba86f14d-5af9-4a98-b3ec-6affe489a027 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087473 Jun 17 13:15:31.062644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1033/2161] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:30 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:31.083462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-19b5d52a-9daf-4e99-ad33-1681f66f82d3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Jun 17 13:15:31.084025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1129/2162] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:31.443224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:15:31.443511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:15:31.520414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-54044e61-7dba-4bdc-8114-913c9384cd15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:31.521380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-54044e61-7dba-4bdc-8114-913c9384cd15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:31.527908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54044e61-7dba-4bdc-8114-913c9384cd15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.528348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54044e61-7dba-4bdc-8114-913c9384cd15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.529112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54044e61-7dba-4bdc-8114-913c9384cd15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.529609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-54044e61-7dba-4bdc-8114-913c9384cd15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.559528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-54044e61-7dba-4bdc-8114-913c9384cd15 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Jun 17 13:15:31.560080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1034/2163] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:32.080371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:32.080938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:32.083323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=86 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:32.089069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.089507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.090263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.090695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.096557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c4f3395b-f7e7-4bd8-a63c-da39200052ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:32.097532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c4f3395b-f7e7-4bd8-a63c-da39200052ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:32.104298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4f3395b-f7e7-4bd8-a63c-da39200052ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.104745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4f3395b-f7e7-4bd8-a63c-da39200052ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.105508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4f3395b-f7e7-4bd8-a63c-da39200052ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.106019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4f3395b-f7e7-4bd8-a63c-da39200052ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.137292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c4f3395b-f7e7-4bd8-a63c-da39200052ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Jun 17 13:15:32.137853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1035/2164] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:32 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:32.152982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:32.160910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-21b19c19-6345-4ecb-b53b-cf0e6dd09998 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084514 Jun 17 13:15:32.161462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1130/2165] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:32.571858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4d25ea31-6d5c-4a08-bd4e-03dc10c9730d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:32.572781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4d25ea31-6d5c-4a08-bd4e-03dc10c9730d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:32.579903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d25ea31-6d5c-4a08-bd4e-03dc10c9730d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.580337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d25ea31-6d5c-4a08-bd4e-03dc10c9730d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.581081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d25ea31-6d5c-4a08-bd4e-03dc10c9730d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.581506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d25ea31-6d5c-4a08-bd4e-03dc10c9730d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.585138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:32.611860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4d25ea31-6d5c-4a08-bd4e-03dc10c9730d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Jun 17 13:15:32.612415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1036/2166] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:33.149375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1a7dbce-9527-42ce-bd57-80369854eb80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:33.150334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1a7dbce-9527-42ce-bd57-80369854eb80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:33.157457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a7dbce-9527-42ce-bd57-80369854eb80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.157906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a7dbce-9527-42ce-bd57-80369854eb80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.158663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a7dbce-9527-42ce-bd57-80369854eb80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.159093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a7dbce-9527-42ce-bd57-80369854eb80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.178381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:33.178959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:33.186124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.186570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.187344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.187881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.190103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1a7dbce-9527-42ce-bd57-80369854eb80 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Jun 17 13:15:33.190637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1131/2167] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:33 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:33.250011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:33.258069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df4f688a-7e60-4045-972f-2885ea02f0f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083647 Jun 17 13:15:33.258629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1037/2168] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:33.624306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dfb87243-9a43-421a-be94-f52233489733 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:33.625228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dfb87243-9a43-421a-be94-f52233489733 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:33.632188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfb87243-9a43-421a-be94-f52233489733 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.632635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfb87243-9a43-421a-be94-f52233489733 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.633396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfb87243-9a43-421a-be94-f52233489733 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.633849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dfb87243-9a43-421a-be94-f52233489733 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.664609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dfb87243-9a43-421a-be94-f52233489733 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Jun 17 13:15:33.665191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1132/2169] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:34.202437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eb7d0576-a085-4feb-b9ae-3610122de082 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:34.203364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eb7d0576-a085-4feb-b9ae-3610122de082 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:34.210198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb7d0576-a085-4feb-b9ae-3610122de082 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.210641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb7d0576-a085-4feb-b9ae-3610122de082 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.211405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb7d0576-a085-4feb-b9ae-3610122de082 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.211859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb7d0576-a085-4feb-b9ae-3610122de082 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.246782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eb7d0576-a085-4feb-b9ae-3610122de082 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Jun 17 13:15:34.247322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1038/2170] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:34 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:34.276487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:34.277080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:34.284301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.284729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.285482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.285947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.351785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:34.360064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3673324c-d36b-49fa-8093-2aa04d9aee61 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087358 Jun 17 13:15:34.360641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1133/2171] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:34.676811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d85e1699-4749-42c4-9ea6-c331b4d4ead3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:34.677739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d85e1699-4749-42c4-9ea6-c331b4d4ead3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:34.684289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d85e1699-4749-42c4-9ea6-c331b4d4ead3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.684738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d85e1699-4749-42c4-9ea6-c331b4d4ead3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.685507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d85e1699-4749-42c4-9ea6-c331b4d4ead3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.686046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d85e1699-4749-42c4-9ea6-c331b4d4ead3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.716682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d85e1699-4749-42c4-9ea6-c331b4d4ead3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Jun 17 13:15:34.717391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1039/2172] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:35.263280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6e12d516-d32f-46ee-8a11-4edeb7110b49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:35.264841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6e12d516-d32f-46ee-8a11-4edeb7110b49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:35.272190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e12d516-d32f-46ee-8a11-4edeb7110b49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.272687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e12d516-d32f-46ee-8a11-4edeb7110b49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.273529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e12d516-d32f-46ee-8a11-4edeb7110b49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.274013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e12d516-d32f-46ee-8a11-4edeb7110b49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.304416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6e12d516-d32f-46ee-8a11-4edeb7110b49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047886 Jun 17 13:15:35.305057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1134/2173] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:35 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:35.378049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:35.378932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:35.385969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.386422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.387179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.387775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.450584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:35.458357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-015acfef-efa4-45ba-879d-3f9ae91bcc90 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084759 Jun 17 13:15:35.458923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1040/2174] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:35.733298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ebc24d67-9eaa-4266-b6a9-52dd00ec4e4a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:35.734191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ebc24d67-9eaa-4266-b6a9-52dd00ec4e4a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:35.740618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebc24d67-9eaa-4266-b6a9-52dd00ec4e4a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.741061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebc24d67-9eaa-4266-b6a9-52dd00ec4e4a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.741799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebc24d67-9eaa-4266-b6a9-52dd00ec4e4a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.742222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ebc24d67-9eaa-4266-b6a9-52dd00ec4e4a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.772353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ebc24d67-9eaa-4266-b6a9-52dd00ec4e4a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Jun 17 13:15:35.772897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1135/2175] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:36.320653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ac66446b-834a-423b-8376-c1f5849a5471 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:36.322306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ac66446b-834a-423b-8376-c1f5849a5471 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:36.332954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac66446b-834a-423b-8376-c1f5849a5471 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.333693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac66446b-834a-423b-8376-c1f5849a5471 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.334936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac66446b-834a-423b-8376-c1f5849a5471 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.335702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac66446b-834a-423b-8376-c1f5849a5471 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.367744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ac66446b-834a-423b-8376-c1f5849a5471 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054159 Jun 17 13:15:36.368268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1041/2176] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:36 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:36.480001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:36.480974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:36.489568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.490158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.491146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.491685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.571747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:36.580494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4141ce97-8757-4baf-b6d9-2ef96e111643 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.107174 Jun 17 13:15:36.581059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1136/2177] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:36.788963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5469a325-7d76-4558-a847-8e86e5773622 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:36.790512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5469a325-7d76-4558-a847-8e86e5773622 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:36.801076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5469a325-7d76-4558-a847-8e86e5773622 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.801825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5469a325-7d76-4558-a847-8e86e5773622 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.803084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5469a325-7d76-4558-a847-8e86e5773622 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.803840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5469a325-7d76-4558-a847-8e86e5773622 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.838959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5469a325-7d76-4558-a847-8e86e5773622 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056523 Jun 17 13:15:36.839842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1042/2178] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:37.385282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2513d228-d15b-4462-bca8-dfffb6cfb56e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:37.386744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2513d228-d15b-4462-bca8-dfffb6cfb56e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:37.394626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2513d228-d15b-4462-bca8-dfffb6cfb56e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.395100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2513d228-d15b-4462-bca8-dfffb6cfb56e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.395983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2513d228-d15b-4462-bca8-dfffb6cfb56e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.396401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2513d228-d15b-4462-bca8-dfffb6cfb56e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.426006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2513d228-d15b-4462-bca8-dfffb6cfb56e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048501 Jun 17 13:15:37.426587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1137/2179] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:37 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:37.601939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:37.602986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:37.613599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.614315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.615600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.616316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.684366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:37.692446 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-807373db-dc4d-4c6e-a41f-c3d1dbfaf6bc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097115 Jun 17 13:15:37.693042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1043/2180] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:37.856066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8cd153fb-820f-4798-b7f6-1ecf57f304c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:37.857602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8cd153fb-820f-4798-b7f6-1ecf57f304c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:37.869137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cd153fb-820f-4798-b7f6-1ecf57f304c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.869890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cd153fb-820f-4798-b7f6-1ecf57f304c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.871188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cd153fb-820f-4798-b7f6-1ecf57f304c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.871963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cd153fb-820f-4798-b7f6-1ecf57f304c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.911972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8cd153fb-820f-4798-b7f6-1ecf57f304c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062187 Jun 17 13:15:37.912708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1138/2181] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:38.438966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d58202ba-fae4-4338-8b23-9442e47ead49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:38.439851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d58202ba-fae4-4338-8b23-9442e47ead49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:38.446835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d58202ba-fae4-4338-8b23-9442e47ead49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.447276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d58202ba-fae4-4338-8b23-9442e47ead49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.448035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d58202ba-fae4-4338-8b23-9442e47ead49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.448472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d58202ba-fae4-4338-8b23-9442e47ead49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.636942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d58202ba-fae4-4338-8b23-9442e47ead49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202688 Jun 17 13:15:38.637483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1044/2182] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:38 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:38.717829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:38.718779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:38.729168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.729920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.731148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.731904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.802989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:38.810957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4680418c-f294-4e2c-8a04-8022b1fc71f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099737 Jun 17 13:15:38.811551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1139/2183] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:38.928606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1df45d44-2d1c-43ee-8ac2-20391e551ffa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:38.930093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1df45d44-2d1c-43ee-8ac2-20391e551ffa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:38.933045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=84 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:38.942263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1df45d44-2d1c-43ee-8ac2-20391e551ffa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.943039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1df45d44-2d1c-43ee-8ac2-20391e551ffa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.944363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1df45d44-2d1c-43ee-8ac2-20391e551ffa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.945077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1df45d44-2d1c-43ee-8ac2-20391e551ffa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.977906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1df45d44-2d1c-43ee-8ac2-20391e551ffa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055963 Jun 17 13:15:38.978362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1045/2184] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:39.652482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3d89ef4d-e28c-429e-80df-2b25d01657a7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:39.653694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3d89ef4d-e28c-429e-80df-2b25d01657a7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:39.664564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d89ef4d-e28c-429e-80df-2b25d01657a7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.665252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d89ef4d-e28c-429e-80df-2b25d01657a7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.666443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d89ef4d-e28c-429e-80df-2b25d01657a7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.667115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d89ef4d-e28c-429e-80df-2b25d01657a7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.698027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3d89ef4d-e28c-429e-80df-2b25d01657a7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052243 Jun 17 13:15:39.698583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1140/2185] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:39 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:39.829903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:39.830521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:39.837517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.837975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.838739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.839175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.901597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:39.909779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-696c9faa-1518-4145-a159-34494cd36410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084677 Jun 17 13:15:39.910263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1046/2186] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:39.995148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-18d3d6fd-1414-4747-a209-af349e16e757 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:39.996720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-18d3d6fd-1414-4747-a209-af349e16e757 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:40.004686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18d3d6fd-1414-4747-a209-af349e16e757 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.005139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18d3d6fd-1414-4747-a209-af349e16e757 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.005903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18d3d6fd-1414-4747-a209-af349e16e757 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.006342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18d3d6fd-1414-4747-a209-af349e16e757 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.036690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-18d3d6fd-1414-4747-a209-af349e16e757 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048141 Jun 17 13:15:40.037386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1141/2187] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:40.712435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5404699f-20db-4f7e-8401-25bda4494567 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:40.713503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5404699f-20db-4f7e-8401-25bda4494567 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:40.721373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5404699f-20db-4f7e-8401-25bda4494567 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.721806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5404699f-20db-4f7e-8401-25bda4494567 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.722548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5404699f-20db-4f7e-8401-25bda4494567 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.722980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5404699f-20db-4f7e-8401-25bda4494567 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.752996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5404699f-20db-4f7e-8401-25bda4494567 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Jun 17 13:15:40.753456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1047/2188] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:40 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:40.928250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:40.928896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:40.935766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.936203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.936945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.937369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.001543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:41.013315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-88ce79b8-5a53-479b-b773-f8fcc5409dee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088665 Jun 17 13:15:41.014080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1142/2189] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:40 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:41.050167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34f95576-530e-41a9-b382-c25e5992c53b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:41.051092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34f95576-530e-41a9-b382-c25e5992c53b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:41.058118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f95576-530e-41a9-b382-c25e5992c53b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.058566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f95576-530e-41a9-b382-c25e5992c53b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.059327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f95576-530e-41a9-b382-c25e5992c53b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.059799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34f95576-530e-41a9-b382-c25e5992c53b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.089810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34f95576-530e-41a9-b382-c25e5992c53b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Jun 17 13:15:41.090380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1048/2190] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:41.770228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-78ce0379-b833-4858-bc4c-d2777a51f916 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:41.771308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-78ce0379-b833-4858-bc4c-d2777a51f916 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:41.778512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78ce0379-b833-4858-bc4c-d2777a51f916 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.778958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78ce0379-b833-4858-bc4c-d2777a51f916 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.779755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78ce0379-b833-4858-bc4c-d2777a51f916 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.780176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-78ce0379-b833-4858-bc4c-d2777a51f916 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.811124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-78ce0379-b833-4858-bc4c-d2777a51f916 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048030 Jun 17 13:15:41.811712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1143/2191] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:41 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:42.032262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:42.032792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:42.039466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.039909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.040666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.041096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.102174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1ead531e-7733-4541-a8b6-2516a8d1c8a0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:42.103098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1ead531e-7733-4541-a8b6-2516a8d1c8a0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:42.109937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ead531e-7733-4541-a8b6-2516a8d1c8a0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.110390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ead531e-7733-4541-a8b6-2516a8d1c8a0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.111159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ead531e-7733-4541-a8b6-2516a8d1c8a0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.111618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ead531e-7733-4541-a8b6-2516a8d1c8a0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.112888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:42.120720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8493d0fd-8fea-419b-b165-04a976a447c0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092444 Jun 17 13:15:42.121331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1049/2192] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:42.142848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1ead531e-7733-4541-a8b6-2516a8d1c8a0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Jun 17 13:15:42.143456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1144/2193] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:42.830651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c14f0dfe-1dd3-4c02-bb7e-5465e652de3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:42.832285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c14f0dfe-1dd3-4c02-bb7e-5465e652de3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:42.845657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c14f0dfe-1dd3-4c02-bb7e-5465e652de3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.846396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c14f0dfe-1dd3-4c02-bb7e-5465e652de3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.850381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c14f0dfe-1dd3-4c02-bb7e-5465e652de3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.850858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c14f0dfe-1dd3-4c02-bb7e-5465e652de3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.882599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c14f0dfe-1dd3-4c02-bb7e-5465e652de3e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058887 Jun 17 13:15:42.883148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1050/2194] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:42 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:43.139418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:43.140110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:43.147945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.148390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.149151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.149580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.154367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a64c397a-a60a-4c8b-b4ba-974f3c5d20fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:43.155292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a64c397a-a60a-4c8b-b4ba-974f3c5d20fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:43.162292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a64c397a-a60a-4c8b-b4ba-974f3c5d20fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.162740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a64c397a-a60a-4c8b-b4ba-974f3c5d20fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.163547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a64c397a-a60a-4c8b-b4ba-974f3c5d20fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.163975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a64c397a-a60a-4c8b-b4ba-974f3c5d20fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.168673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:43.196154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a64c397a-a60a-4c8b-b4ba-974f3c5d20fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Jun 17 13:15:43.196832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1051/2195] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:43 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:43.217136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:43.225206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0ae8923-251b-4f35-95bc-1ca093a0622f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090431 Jun 17 13:15:43.225766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1145/2196] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:43.895442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-05449fe6-5da4-436b-8b8b-9b0721c41984 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:43.896500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-05449fe6-5da4-436b-8b8b-9b0721c41984 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:43.903609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05449fe6-5da4-436b-8b8b-9b0721c41984 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.904099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05449fe6-5da4-436b-8b8b-9b0721c41984 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.904950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05449fe6-5da4-436b-8b8b-9b0721c41984 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.905425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05449fe6-5da4-436b-8b8b-9b0721c41984 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.933743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:43.938694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-05449fe6-5da4-436b-8b8b-9b0721c41984 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047900 Jun 17 13:15:43.939216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1052/2197] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:43 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:44.208452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5b0cea44-9f0a-4128-87b6-cc5c9d6b920d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:44.209385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5b0cea44-9f0a-4128-87b6-cc5c9d6b920d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:44.216482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b0cea44-9f0a-4128-87b6-cc5c9d6b920d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.216927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b0cea44-9f0a-4128-87b6-cc5c9d6b920d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.217694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b0cea44-9f0a-4128-87b6-cc5c9d6b920d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.218131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b0cea44-9f0a-4128-87b6-cc5c9d6b920d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.242850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:44.243469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:44.249068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5b0cea44-9f0a-4128-87b6-cc5c9d6b920d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Jun 17 13:15:44.249843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1146/2198] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:44.250894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.251397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.252175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.252575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.319935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:44.330412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2c8e379b-2555-4536-856a-befcd5ab2a24 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091741 Jun 17 13:15:44.331219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1053/2199] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:44.955012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c903d62b-e0b8-49a5-bd0a-d575ea655abe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:44.956544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c903d62b-e0b8-49a5-bd0a-d575ea655abe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:44.966846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c903d62b-e0b8-49a5-bd0a-d575ea655abe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.967683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c903d62b-e0b8-49a5-bd0a-d575ea655abe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.968929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c903d62b-e0b8-49a5-bd0a-d575ea655abe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.969650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c903d62b-e0b8-49a5-bd0a-d575ea655abe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.001372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c903d62b-e0b8-49a5-bd0a-d575ea655abe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053006 Jun 17 13:15:45.001930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1147/2200] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:44 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:45.265620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3fba01e-0224-47f1-8293-cb979db694d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:45.267157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3fba01e-0224-47f1-8293-cb979db694d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:45.275493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3fba01e-0224-47f1-8293-cb979db694d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.275934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3fba01e-0224-47f1-8293-cb979db694d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.276687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3fba01e-0224-47f1-8293-cb979db694d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.277117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3fba01e-0224-47f1-8293-cb979db694d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.306803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3fba01e-0224-47f1-8293-cb979db694d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047800 Jun 17 13:15:45.307349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1054/2201] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:45.348387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:45.348988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:45.356067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.356513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.357263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.357694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.420153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:45.428220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5598ba44-06f1-4a82-b703-3d8faf97fe2f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083857 Jun 17 13:15:45.428779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1148/2202] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:46.017414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6e8724b-45c8-43d9-a65f-19a5c97fcf69 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:46.018886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6e8724b-45c8-43d9-a65f-19a5c97fcf69 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:46.026369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8724b-45c8-43d9-a65f-19a5c97fcf69 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.026809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8724b-45c8-43d9-a65f-19a5c97fcf69 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.027593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8724b-45c8-43d9-a65f-19a5c97fcf69 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.028020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8724b-45c8-43d9-a65f-19a5c97fcf69 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.058946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6e8724b-45c8-43d9-a65f-19a5c97fcf69 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048142 Jun 17 13:15:46.059504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1055/2203] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:46 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:46.322963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3cc7d87d-df5b-4967-bdc3-e43164c069d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:46.324528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3cc7d87d-df5b-4967-bdc3-e43164c069d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:46.334406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cc7d87d-df5b-4967-bdc3-e43164c069d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.334851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cc7d87d-df5b-4967-bdc3-e43164c069d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.335644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cc7d87d-df5b-4967-bdc3-e43164c069d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.336073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3cc7d87d-df5b-4967-bdc3-e43164c069d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.365540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3cc7d87d-df5b-4967-bdc3-e43164c069d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049282 Jun 17 13:15:46.366293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1149/2204] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:46.454314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:46.455142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:46.467161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.467953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.469197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.469913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.537163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:46.545405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6c2d146-9caa-4bd6-98ea-79fd1730e725 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097790 Jun 17 13:15:46.545964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1056/2205] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:47.074612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-89e06280-9647-434f-a357-bbcc892e5860 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:47.075916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-89e06280-9647-434f-a357-bbcc892e5860 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:47.084894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89e06280-9647-434f-a357-bbcc892e5860 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.085324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89e06280-9647-434f-a357-bbcc892e5860 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.086071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89e06280-9647-434f-a357-bbcc892e5860 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.086492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-89e06280-9647-434f-a357-bbcc892e5860 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.116003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-89e06280-9647-434f-a357-bbcc892e5860 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048398 Jun 17 13:15:47.116580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1150/2206] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:47 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:47.383463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-77cefa14-6dee-42bd-b727-a5398b8f8389 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:47.384410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-77cefa14-6dee-42bd-b727-a5398b8f8389 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:47.391269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77cefa14-6dee-42bd-b727-a5398b8f8389 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.391817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77cefa14-6dee-42bd-b727-a5398b8f8389 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.392652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77cefa14-6dee-42bd-b727-a5398b8f8389 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.393099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77cefa14-6dee-42bd-b727-a5398b8f8389 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.425904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-77cefa14-6dee-42bd-b727-a5398b8f8389 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048174 Jun 17 13:15:47.426465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1057/2207] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:47.568750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:47.569789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:47.576425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.576919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.577704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.578134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.640776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:47.648675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a82f1921-d4c8-45d3-8dd1-f87479e07570 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084953 Jun 17 13:15:47.653072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1151/2208] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:48.131783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70d7a563-dfaa-469b-8d04-0c4c93de8903 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:48.132739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70d7a563-dfaa-469b-8d04-0c4c93de8903 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:48.139829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d7a563-dfaa-469b-8d04-0c4c93de8903 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.140274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d7a563-dfaa-469b-8d04-0c4c93de8903 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.141180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d7a563-dfaa-469b-8d04-0c4c93de8903 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.141660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d7a563-dfaa-469b-8d04-0c4c93de8903 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.171927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70d7a563-dfaa-469b-8d04-0c4c93de8903 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Jun 17 13:15:48.172481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1058/2209] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:48 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:48.438324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fdb66969-4f80-469b-b317-4e0c52d545f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:48.439159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fdb66969-4f80-469b-b317-4e0c52d545f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:48.446424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdb66969-4f80-469b-b317-4e0c52d545f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.446867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdb66969-4f80-469b-b317-4e0c52d545f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.447646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdb66969-4f80-469b-b317-4e0c52d545f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.448066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fdb66969-4f80-469b-b317-4e0c52d545f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.479458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fdb66969-4f80-469b-b317-4e0c52d545f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Jun 17 13:15:48.479995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1152/2210] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:48.667187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:48.667823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:48.682592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.683040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.683950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.684383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.768936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:48.778966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-78a6efab-c5e2-4107-8eb3-5d04e0a7d2ba tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.115881 Jun 17 13:15:48.779593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1059/2211] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:49.187957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-efb681cc-563e-48e7-a170-64b4d8431cf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:49.189492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-efb681cc-563e-48e7-a170-64b4d8431cf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:49.200566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb681cc-563e-48e7-a170-64b4d8431cf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.201336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb681cc-563e-48e7-a170-64b4d8431cf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.202574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb681cc-563e-48e7-a170-64b4d8431cf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.203296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb681cc-563e-48e7-a170-64b4d8431cf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.237784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-efb681cc-563e-48e7-a170-64b4d8431cf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056525 Jun 17 13:15:49.238689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1153/2212] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:49 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:49.491423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e35b73c5-ab4a-41f0-be77-ea6e680b22a8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:49.492379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e35b73c5-ab4a-41f0-be77-ea6e680b22a8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:49.499499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e35b73c5-ab4a-41f0-be77-ea6e680b22a8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.499957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e35b73c5-ab4a-41f0-be77-ea6e680b22a8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.501065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e35b73c5-ab4a-41f0-be77-ea6e680b22a8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.501497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e35b73c5-ab4a-41f0-be77-ea6e680b22a8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.532643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e35b73c5-ab4a-41f0-be77-ea6e680b22a8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Jun 17 13:15:49.533199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1060/2213] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:49.800347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:49.801377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:49.809447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.809886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.810624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.811044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.874147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:49.882295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-12626dec-2f3f-4f87-85bb-50df31a324a6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088360 Jun 17 13:15:49.883054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1154/2214] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:50.253447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c876c2d2-ef9c-4480-a204-d382970e7dd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:50.254593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c876c2d2-ef9c-4480-a204-d382970e7dd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:50.261908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c876c2d2-ef9c-4480-a204-d382970e7dd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.262356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c876c2d2-ef9c-4480-a204-d382970e7dd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.263094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c876c2d2-ef9c-4480-a204-d382970e7dd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.263563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c876c2d2-ef9c-4480-a204-d382970e7dd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.297451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c876c2d2-ef9c-4480-a204-d382970e7dd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049357 Jun 17 13:15:50.298000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1061/2215] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:50.544984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11682f2d-f95f-4c87-b971-9877e61daa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:50.545944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11682f2d-f95f-4c87-b971-9877e61daa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:50.552868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11682f2d-f95f-4c87-b971-9877e61daa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.553310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11682f2d-f95f-4c87-b971-9877e61daa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.554063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11682f2d-f95f-4c87-b971-9877e61daa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.554493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11682f2d-f95f-4c87-b971-9877e61daa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.583937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11682f2d-f95f-4c87-b971-9877e61daa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043199 Jun 17 13:15:50.584489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1155/2216] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:50 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:50.903635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:50.904680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:50.915663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.916403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.917655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.918382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.992906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:51.002881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-42295b48-6212-4ea6-823e-e319d8f71839 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.105866 Jun 17 13:15:51.003467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1062/2217] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:51.312673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-349171fc-2bcf-4e51-968a-40cad76a92d8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:51.313606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-349171fc-2bcf-4e51-968a-40cad76a92d8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:51.320171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349171fc-2bcf-4e51-968a-40cad76a92d8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.320613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349171fc-2bcf-4e51-968a-40cad76a92d8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.321366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349171fc-2bcf-4e51-968a-40cad76a92d8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.321834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349171fc-2bcf-4e51-968a-40cad76a92d8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.351839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-349171fc-2bcf-4e51-968a-40cad76a92d8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Jun 17 13:15:51.352396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1156/2218] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:51 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:51.600460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-87b9f45b-91c5-486b-8cc4-652cf5782e67 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:51.601823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-87b9f45b-91c5-486b-8cc4-652cf5782e67 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:51.611567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b9f45b-91c5-486b-8cc4-652cf5782e67 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.612064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b9f45b-91c5-486b-8cc4-652cf5782e67 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.612906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b9f45b-91c5-486b-8cc4-652cf5782e67 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.613403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87b9f45b-91c5-486b-8cc4-652cf5782e67 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.645938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-87b9f45b-91c5-486b-8cc4-652cf5782e67 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052609 Jun 17 13:15:51.646476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1063/2219] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:52.026986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:52.027992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:52.036388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.036825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.037570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.037993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.110770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:52.118844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-249ff758-57bd-4473-8721-e3ca1187b11f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098287 Jun 17 13:15:52.119444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1157/2220] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:52.365286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-11788d25-146a-4d5d-be7a-f64969339388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:52.366330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-11788d25-146a-4d5d-be7a-f64969339388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:52.373682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11788d25-146a-4d5d-be7a-f64969339388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.374175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11788d25-146a-4d5d-be7a-f64969339388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.374902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11788d25-146a-4d5d-be7a-f64969339388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.375741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11788d25-146a-4d5d-be7a-f64969339388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.407803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-11788d25-146a-4d5d-be7a-f64969339388 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046606 Jun 17 13:15:52.408316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1064/2221] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:52.661012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43c85e62-d168-4f4c-b45b-2cf5689150b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:52.661899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43c85e62-d168-4f4c-b45b-2cf5689150b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:52.670996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c85e62-d168-4f4c-b45b-2cf5689150b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.671923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c85e62-d168-4f4c-b45b-2cf5689150b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.673324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c85e62-d168-4f4c-b45b-2cf5689150b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.673921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c85e62-d168-4f4c-b45b-2cf5689150b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.710306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43c85e62-d168-4f4c-b45b-2cf5689150b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054258 Jun 17 13:15:52.710899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1158/2222] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:53.144080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:53.144700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:53.151149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.151700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.152465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.152896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.223218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:53.235172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ea037227-5557-42ad-bd75-7e1190731334 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095537 Jun 17 13:15:53.235945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1065/2223] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:53.422031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ab436d67-c9fb-4636-99cb-6030432e7b90 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:53.422868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ab436d67-c9fb-4636-99cb-6030432e7b90 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:53.430096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab436d67-c9fb-4636-99cb-6030432e7b90 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.430634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab436d67-c9fb-4636-99cb-6030432e7b90 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.431421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab436d67-c9fb-4636-99cb-6030432e7b90 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.431859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab436d67-c9fb-4636-99cb-6030432e7b90 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.465841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ab436d67-c9fb-4636-99cb-6030432e7b90 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Jun 17 13:15:53.466583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1159/2224] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:53.726059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6c1192f3-dd83-4be7-89f5-066bf96321ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:53.727606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6c1192f3-dd83-4be7-89f5-066bf96321ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:53.737179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c1192f3-dd83-4be7-89f5-066bf96321ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.737626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c1192f3-dd83-4be7-89f5-066bf96321ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.738385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c1192f3-dd83-4be7-89f5-066bf96321ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.738816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6c1192f3-dd83-4be7-89f5-066bf96321ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.781222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6c1192f3-dd83-4be7-89f5-066bf96321ea tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061859 Jun 17 13:15:53.782282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1066/2225] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:54.261382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:54.262431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:54.273104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.273854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.275100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.275887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.338802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:54.347071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6a29469c-6262-4fbc-b1c0-ce797ee87ec4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092233 Jun 17 13:15:54.347674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1160/2226] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:54.483934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-16a66ddb-9f3c-40c7-83f3-3173dd8950c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:54.485094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-16a66ddb-9f3c-40c7-83f3-3173dd8950c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:54.491716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16a66ddb-9f3c-40c7-83f3-3173dd8950c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.492163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16a66ddb-9f3c-40c7-83f3-3173dd8950c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.492921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16a66ddb-9f3c-40c7-83f3-3173dd8950c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.493359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16a66ddb-9f3c-40c7-83f3-3173dd8950c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.523659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-16a66ddb-9f3c-40c7-83f3-3173dd8950c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Jun 17 13:15:54.524216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1067/2227] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:54.799358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-24c6279e-2d0f-466b-906f-1c5bdf2d5907 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:54.800892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-24c6279e-2d0f-466b-906f-1c5bdf2d5907 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:54.811664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24c6279e-2d0f-466b-906f-1c5bdf2d5907 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.812489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24c6279e-2d0f-466b-906f-1c5bdf2d5907 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.813131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24c6279e-2d0f-466b-906f-1c5bdf2d5907 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.813588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24c6279e-2d0f-466b-906f-1c5bdf2d5907 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.843401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-24c6279e-2d0f-466b-906f-1c5bdf2d5907 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050883 Jun 17 13:15:54.844068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1161/2228] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:54 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:55.368281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:55.369048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:55.378945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.379459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.380586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.381159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.452617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:55.460862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f940b23b-25e1-4dde-9f11-3b12967b5c1b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097805 Jun 17 13:15:55.461418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1068/2229] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:55.536648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2483962e-0ff2-4159-be25-e5592b4ee845 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:55.537615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2483962e-0ff2-4159-be25-e5592b4ee845 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:55.544261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2483962e-0ff2-4159-be25-e5592b4ee845 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.544714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2483962e-0ff2-4159-be25-e5592b4ee845 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.545473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2483962e-0ff2-4159-be25-e5592b4ee845 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.545905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2483962e-0ff2-4159-be25-e5592b4ee845 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.549678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:55.576504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2483962e-0ff2-4159-be25-e5592b4ee845 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Jun 17 13:15:55.577066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1162/2230] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:55 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:55.860029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-570558e1-ecdc-4238-8c64-6029fb65d08e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:55.860994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-570558e1-ecdc-4238-8c64-6029fb65d08e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:55.867580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-570558e1-ecdc-4238-8c64-6029fb65d08e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.868029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-570558e1-ecdc-4238-8c64-6029fb65d08e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.868784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-570558e1-ecdc-4238-8c64-6029fb65d08e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.869216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-570558e1-ecdc-4238-8c64-6029fb65d08e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.886263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:55.900220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-570558e1-ecdc-4238-8c64-6029fb65d08e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046954 Jun 17 13:15:55.900778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1069/2231] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:56.478489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:56.479073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:56.485675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.486123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.486848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.487526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.588949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bf191d1e-de50-40c3-9c29-ba820ed76288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:56.589895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bf191d1e-de50-40c3-9c29-ba820ed76288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:56.598178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf191d1e-de50-40c3-9c29-ba820ed76288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.598616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf191d1e-de50-40c3-9c29-ba820ed76288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.599406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf191d1e-de50-40c3-9c29-ba820ed76288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.599872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf191d1e-de50-40c3-9c29-ba820ed76288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.634202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bf191d1e-de50-40c3-9c29-ba820ed76288 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049167 Jun 17 13:15:56.634793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1070/2232] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:56.795012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:56.803800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eee27502-0bc7-414e-8ecf-e08b6ada8c33 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.329165 Jun 17 13:15:56.804354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1163/2233] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:56.917095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a1e361b-f40e-4508-9f0e-a2c4ef3411bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:56.918002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a1e361b-f40e-4508-9f0e-a2c4ef3411bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:56.924798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a1e361b-f40e-4508-9f0e-a2c4ef3411bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.925244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a1e361b-f40e-4508-9f0e-a2c4ef3411bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.926040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a1e361b-f40e-4508-9f0e-a2c4ef3411bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.926493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a1e361b-f40e-4508-9f0e-a2c4ef3411bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.957431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a1e361b-f40e-4508-9f0e-a2c4ef3411bf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Jun 17 13:15:56.957997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1071/2234] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:56 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:57.647779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de08a429-410b-490f-a194-c84d9d81759b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:57.648725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-de08a429-410b-490f-a194-c84d9d81759b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:57.655740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de08a429-410b-490f-a194-c84d9d81759b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.656185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de08a429-410b-490f-a194-c84d9d81759b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.656935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de08a429-410b-490f-a194-c84d9d81759b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.657650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de08a429-410b-490f-a194-c84d9d81759b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.687573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-de08a429-410b-490f-a194-c84d9d81759b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Jun 17 13:15:57.688132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1164/2235] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:57.825489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:57.826502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:57.838428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.839215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.840758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.841483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.906163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:57.914164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-20a4dbdf-7c89-4416-9219-6bdb506e177e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095253 Jun 17 13:15:57.914721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1072/2236] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:57.968792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dd610100-9c8c-468b-9d4d-593c6bf6749e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:57.969821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dd610100-9c8c-468b-9d4d-593c6bf6749e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:57.976663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd610100-9c8c-468b-9d4d-593c6bf6749e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.977111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd610100-9c8c-468b-9d4d-593c6bf6749e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.977840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd610100-9c8c-468b-9d4d-593c6bf6749e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.978312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dd610100-9c8c-468b-9d4d-593c6bf6749e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.008758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dd610100-9c8c-468b-9d4d-593c6bf6749e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Jun 17 13:15:58.009306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1165/2237] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:57 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:58.699110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e62bcee-d0da-4bb7-81ee-89a18b7f7a60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:58.700168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e62bcee-d0da-4bb7-81ee-89a18b7f7a60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:58.706923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e62bcee-d0da-4bb7-81ee-89a18b7f7a60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.707358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e62bcee-d0da-4bb7-81ee-89a18b7f7a60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.708134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e62bcee-d0da-4bb7-81ee-89a18b7f7a60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.708558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e62bcee-d0da-4bb7-81ee-89a18b7f7a60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.738549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e62bcee-d0da-4bb7-81ee-89a18b7f7a60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Jun 17 13:15:58.739342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1073/2238] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:58.935319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:58.936407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:58.948287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.949037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.950426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.951045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.020687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:15:59.020898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-67f5810e-ca66-4c8c-a714-3704bf07025d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:59.021806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-67f5810e-ca66-4c8c-a714-3704bf07025d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:59.028674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67f5810e-ca66-4c8c-a714-3704bf07025d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.028845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-918f1001-1778-462c-97ad-880bffbb0076 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099846 Jun 17 13:15:59.029115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67f5810e-ca66-4c8c-a714-3704bf07025d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.029527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1166/2239] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:15:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:15:59.029887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67f5810e-ca66-4c8c-a714-3704bf07025d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.030384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67f5810e-ca66-4c8c-a714-3704bf07025d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.060859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-67f5810e-ca66-4c8c-a714-3704bf07025d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044669 Jun 17 13:15:59.061422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1074/2240] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:59 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:59.754965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f57e0720-3b27-4f26-b78e-835ce4474e38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:59.756701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f57e0720-3b27-4f26-b78e-835ce4474e38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:59.767284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f57e0720-3b27-4f26-b78e-835ce4474e38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.768092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f57e0720-3b27-4f26-b78e-835ce4474e38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.769328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f57e0720-3b27-4f26-b78e-835ce4474e38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.770032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f57e0720-3b27-4f26-b78e-835ce4474e38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.800307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f57e0720-3b27-4f26-b78e-835ce4474e38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052519 Jun 17 13:15:59.800877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1167/2241] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:00.046429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:00.047024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:00.054269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.054711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.055501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.055940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.072809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1751b976-477b-482d-ae9f-b6ab2b3bbaa3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:00.073839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1751b976-477b-482d-ae9f-b6ab2b3bbaa3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:00.081300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1751b976-477b-482d-ae9f-b6ab2b3bbaa3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.081848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1751b976-477b-482d-ae9f-b6ab2b3bbaa3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.082625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1751b976-477b-482d-ae9f-b6ab2b3bbaa3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.083078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1751b976-477b-482d-ae9f-b6ab2b3bbaa3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.121429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1751b976-477b-482d-ae9f-b6ab2b3bbaa3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052878 Jun 17 13:16:00.122066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1168/2242] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:00.124264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:00.132711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d956e98b-848a-48c3-8b9f-321075797880 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090270 Jun 17 13:16:00.133267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1075/2243] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:00.817573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5df0c1af-40ec-4675-9ced-f95b1e2416bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:00.819233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5df0c1af-40ec-4675-9ced-f95b1e2416bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:00.826357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5df0c1af-40ec-4675-9ced-f95b1e2416bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.826808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5df0c1af-40ec-4675-9ced-f95b1e2416bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.827638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5df0c1af-40ec-4675-9ced-f95b1e2416bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.828077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5df0c1af-40ec-4675-9ced-f95b1e2416bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.859145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5df0c1af-40ec-4675-9ced-f95b1e2416bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Jun 17 13:16:00.859644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1169/2244] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:01.134211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b64e9b1b-18c0-4cb6-8331-0c9701defe84 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:01.135144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b64e9b1b-18c0-4cb6-8331-0c9701defe84 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:01.142202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b64e9b1b-18c0-4cb6-8331-0c9701defe84 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.142684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b64e9b1b-18c0-4cb6-8331-0c9701defe84 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.144165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b64e9b1b-18c0-4cb6-8331-0c9701defe84 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.144637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b64e9b1b-18c0-4cb6-8331-0c9701defe84 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.149740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:01.150348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:01.156995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.157444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.158189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.158620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.175433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b64e9b1b-18c0-4cb6-8331-0c9701defe84 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Jun 17 13:16:01.175975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1076/2245] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:01.221946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:01.230621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4db64aa8-30b5-4410-b757-1b72be175aa0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085104 Jun 17 13:16:01.231169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1170/2246] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:01.873836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ca8460cc-815d-4dd9-b9cc-26f9e7d056b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:01.875829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ca8460cc-815d-4dd9-b9cc-26f9e7d056b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:01.885000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8460cc-815d-4dd9-b9cc-26f9e7d056b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.885674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8460cc-815d-4dd9-b9cc-26f9e7d056b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.886873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8460cc-815d-4dd9-b9cc-26f9e7d056b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.887520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ca8460cc-815d-4dd9-b9cc-26f9e7d056b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.920336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ca8460cc-815d-4dd9-b9cc-26f9e7d056b7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051793 Jun 17 13:16:01.920903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1077/2247] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:02.190866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2995583-23e6-4d6c-ab96-abb5373e49cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:02.192428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2995583-23e6-4d6c-ab96-abb5373e49cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:02.195337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=82 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:02.202758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2995583-23e6-4d6c-ab96-abb5373e49cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.203235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2995583-23e6-4d6c-ab96-abb5373e49cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.204119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2995583-23e6-4d6c-ab96-abb5373e49cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.204579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2995583-23e6-4d6c-ab96-abb5373e49cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.235091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2995583-23e6-4d6c-ab96-abb5373e49cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050208 Jun 17 13:16:02.235673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1171/2248] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:02.248408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:02.249031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:02.256582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.257014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.257904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.258337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.324527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:02.332436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3485f4dc-9de2-4592-8c61-c64e29573fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088212 Jun 17 13:16:02.333008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1078/2249] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:02.936932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b62473a0-fa99-4ea3-abfd-4f4aa965c7c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:02.938409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b62473a0-fa99-4ea3-abfd-4f4aa965c7c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:02.947765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b62473a0-fa99-4ea3-abfd-4f4aa965c7c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.948209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b62473a0-fa99-4ea3-abfd-4f4aa965c7c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.948965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b62473a0-fa99-4ea3-abfd-4f4aa965c7c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.949393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b62473a0-fa99-4ea3-abfd-4f4aa965c7c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.978830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b62473a0-fa99-4ea3-abfd-4f4aa965c7c0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048714 Jun 17 13:16:02.979378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1172/2250] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:02 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:03.248489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f7aa33a4-16c5-43b6-8f2c-8bb16dbf2740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:03.249458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f7aa33a4-16c5-43b6-8f2c-8bb16dbf2740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:03.256922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7aa33a4-16c5-43b6-8f2c-8bb16dbf2740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.257397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7aa33a4-16c5-43b6-8f2c-8bb16dbf2740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.258234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7aa33a4-16c5-43b6-8f2c-8bb16dbf2740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.258695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f7aa33a4-16c5-43b6-8f2c-8bb16dbf2740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.288714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f7aa33a4-16c5-43b6-8f2c-8bb16dbf2740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Jun 17 13:16:03.290404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1079/2251] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:03.352838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:03.353727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:03.364573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.365320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.366486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.367255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.434552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:03.445989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-77694e53-0c87-4bed-bb05-79e2483f9ce1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099083 Jun 17 13:16:03.446730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1173/2252] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:03.994154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-305a2770-1e0b-40ca-b24f-b2687f31a533 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:03.995083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-305a2770-1e0b-40ca-b24f-b2687f31a533 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:04.002092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-305a2770-1e0b-40ca-b24f-b2687f31a533 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.002544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-305a2770-1e0b-40ca-b24f-b2687f31a533 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.003292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-305a2770-1e0b-40ca-b24f-b2687f31a533 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.003760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-305a2770-1e0b-40ca-b24f-b2687f31a533 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.033371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-305a2770-1e0b-40ca-b24f-b2687f31a533 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Jun 17 13:16:04.033920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1080/2253] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:04.301741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9e7c49d8-4be0-45e8-8674-3f709d29d0ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:04.302650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9e7c49d8-4be0-45e8-8674-3f709d29d0ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:04.309328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e7c49d8-4be0-45e8-8674-3f709d29d0ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.309764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e7c49d8-4be0-45e8-8674-3f709d29d0ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.310510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e7c49d8-4be0-45e8-8674-3f709d29d0ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.310931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e7c49d8-4be0-45e8-8674-3f709d29d0ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.342413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9e7c49d8-4be0-45e8-8674-3f709d29d0ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Jun 17 13:16:04.342985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1174/2254] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:04.468856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:04.469435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:04.476555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.477003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.477910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.478349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.549661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:04.558336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5e1a2fe9-b168-410f-9161-d226d1536b03 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093431 Jun 17 13:16:04.558928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1081/2255] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:05.045604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1387a243-9052-4522-bf54-bb8328303c22 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:05.046530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1387a243-9052-4522-bf54-bb8328303c22 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:05.053597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1387a243-9052-4522-bf54-bb8328303c22 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.054047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1387a243-9052-4522-bf54-bb8328303c22 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.054803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1387a243-9052-4522-bf54-bb8328303c22 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.055229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1387a243-9052-4522-bf54-bb8328303c22 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.085249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1387a243-9052-4522-bf54-bb8328303c22 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Jun 17 13:16:05.085806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1175/2256] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:05 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:05.354401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-37e8354f-8148-43de-9957-1fba99a31d76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:05.355242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-37e8354f-8148-43de-9957-1fba99a31d76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:05.362125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37e8354f-8148-43de-9957-1fba99a31d76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.362574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37e8354f-8148-43de-9957-1fba99a31d76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.363345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37e8354f-8148-43de-9957-1fba99a31d76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.363816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37e8354f-8148-43de-9957-1fba99a31d76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.394161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-37e8354f-8148-43de-9957-1fba99a31d76 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Jun 17 13:16:05.394770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1082/2257] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:05.589387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:05.590436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:05.600377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.600903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.601977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.602552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.679785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:05.688713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-29bf2f98-efdb-4edd-aa49-4ea28a336719 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.109787 Jun 17 13:16:05.689348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1176/2258] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:06.100100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-31ca06c5-d2bc-42ed-b876-ac00bfd3df17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:06.101292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-31ca06c5-d2bc-42ed-b876-ac00bfd3df17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:06.111013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31ca06c5-d2bc-42ed-b876-ac00bfd3df17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.111623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31ca06c5-d2bc-42ed-b876-ac00bfd3df17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.112636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31ca06c5-d2bc-42ed-b876-ac00bfd3df17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.113220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31ca06c5-d2bc-42ed-b876-ac00bfd3df17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.150027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-31ca06c5-d2bc-42ed-b876-ac00bfd3df17 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055538 Jun 17 13:16:06.150781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1083/2259] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:06 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:16:06.406617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4cecef18-afe4-42b3-b9b6-3798339bc86e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:06.407470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4cecef18-afe4-42b3-b9b6-3798339bc86e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:06.414585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cecef18-afe4-42b3-b9b6-3798339bc86e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.415029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cecef18-afe4-42b3-b9b6-3798339bc86e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.415836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cecef18-afe4-42b3-b9b6-3798339bc86e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.416269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4cecef18-afe4-42b3-b9b6-3798339bc86e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.448549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4cecef18-afe4-42b3-b9b6-3798339bc86e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Jun 17 13:16:06.449137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1177/2260] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:06.708241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:06.708741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:06.715355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.715818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.716569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.716994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.792774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:06.800993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2b1ff1c1-6e9c-4cb9-8f2d-ffb5aa6c6a5a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096776 Jun 17 13:16:06.801553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1084/2261] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:07.162819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7d46c1e0-e69c-4e7f-8957-4852aaf428a8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:07.163784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7d46c1e0-e69c-4e7f-8957-4852aaf428a8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:07.170519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d46c1e0-e69c-4e7f-8957-4852aaf428a8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.171046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d46c1e0-e69c-4e7f-8957-4852aaf428a8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.171849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d46c1e0-e69c-4e7f-8957-4852aaf428a8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.172286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d46c1e0-e69c-4e7f-8957-4852aaf428a8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.202715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:07.207859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7d46c1e0-e69c-4e7f-8957-4852aaf428a8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049053 Jun 17 13:16:07.208415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1178/2262] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:07 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:07.461357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c1f85e15-7f8a-47ac-8efd-1b1baeda31ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:07.462349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c1f85e15-7f8a-47ac-8efd-1b1baeda31ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:07.468852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1f85e15-7f8a-47ac-8efd-1b1baeda31ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.469301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1f85e15-7f8a-47ac-8efd-1b1baeda31ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.470063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1f85e15-7f8a-47ac-8efd-1b1baeda31ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.470494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1f85e15-7f8a-47ac-8efd-1b1baeda31ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.500772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c1f85e15-7f8a-47ac-8efd-1b1baeda31ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Jun 17 13:16:07.501540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1085/2263] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:07 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:07.822566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:07.823568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:07.835026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.835686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.837017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.837652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.914103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:07.922174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76a62c1b-9138-487c-b842-2f28184413f8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.106506 Jun 17 13:16:07.922741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1179/2264] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:08.223813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-827dd8ac-948e-4cc1-b5c7-6a905b4a85aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:08.225300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-827dd8ac-948e-4cc1-b5c7-6a905b4a85aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:08.235231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-827dd8ac-948e-4cc1-b5c7-6a905b4a85aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.235709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-827dd8ac-948e-4cc1-b5c7-6a905b4a85aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.236453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-827dd8ac-948e-4cc1-b5c7-6a905b4a85aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.236879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-827dd8ac-948e-4cc1-b5c7-6a905b4a85aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.240506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:08.267298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-827dd8ac-948e-4cc1-b5c7-6a905b4a85aa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050630 Jun 17 13:16:08.267859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1086/2265] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:08 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:08.513011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-efdb2b82-4ceb-473f-a80d-58f716a1aabc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:08.513963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-efdb2b82-4ceb-473f-a80d-58f716a1aabc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:08.520756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efdb2b82-4ceb-473f-a80d-58f716a1aabc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.521197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efdb2b82-4ceb-473f-a80d-58f716a1aabc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.521944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efdb2b82-4ceb-473f-a80d-58f716a1aabc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.522559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efdb2b82-4ceb-473f-a80d-58f716a1aabc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.553439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-efdb2b82-4ceb-473f-a80d-58f716a1aabc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Jun 17 13:16:08.553972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1180/2266] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:08.943281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:08.944330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:08.947244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=84 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:08.954698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.955139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.955934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.956364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.026363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:09.035264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bb36a3ae-23f5-475f-92eb-580fc4a037db tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098357 Jun 17 13:16:09.035762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1087/2267] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:09.279293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-48fdd735-8da0-4f61-9b63-eeb4d926c76d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:09.280413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-48fdd735-8da0-4f61-9b63-eeb4d926c76d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:09.287728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48fdd735-8da0-4f61-9b63-eeb4d926c76d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.288113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48fdd735-8da0-4f61-9b63-eeb4d926c76d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.288873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48fdd735-8da0-4f61-9b63-eeb4d926c76d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.289298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48fdd735-8da0-4f61-9b63-eeb4d926c76d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.318853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-48fdd735-8da0-4f61-9b63-eeb4d926c76d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Jun 17 13:16:09.319398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1181/2268] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:09 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:09.569723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6a8c4efd-a2f6-4453-b3b5-abf89a3fe703 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:09.571066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6a8c4efd-a2f6-4453-b3b5-abf89a3fe703 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:09.580385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a8c4efd-a2f6-4453-b3b5-abf89a3fe703 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.580857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a8c4efd-a2f6-4453-b3b5-abf89a3fe703 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.581598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a8c4efd-a2f6-4453-b3b5-abf89a3fe703 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.582032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a8c4efd-a2f6-4453-b3b5-abf89a3fe703 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.613060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6a8c4efd-a2f6-4453-b3b5-abf89a3fe703 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050307 Jun 17 13:16:09.613613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1088/2269] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:10.052601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:10.053201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:10.059997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.060445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.061217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.062032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.125390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:10.133443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f231c403-b97d-4d4c-a3e7-1ba8c4ae905d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084877 Jun 17 13:16:10.134010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1182/2270] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:10 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:10.334641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa60ba0b-ebab-4564-b756-227a8c7f4058 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:10.336281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa60ba0b-ebab-4564-b756-227a8c7f4058 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:10.346790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa60ba0b-ebab-4564-b756-227a8c7f4058 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.347581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa60ba0b-ebab-4564-b756-227a8c7f4058 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.349095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa60ba0b-ebab-4564-b756-227a8c7f4058 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.349821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa60ba0b-ebab-4564-b756-227a8c7f4058 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.384269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa60ba0b-ebab-4564-b756-227a8c7f4058 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056466 Jun 17 13:16:10.384744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1089/2271] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:10 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:10.628748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2555a83c-032f-4abf-90a5-996dba7bb384 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:10.629678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2555a83c-032f-4abf-90a5-996dba7bb384 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:10.636409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2555a83c-032f-4abf-90a5-996dba7bb384 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.636790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2555a83c-032f-4abf-90a5-996dba7bb384 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.637538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2555a83c-032f-4abf-90a5-996dba7bb384 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.637976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2555a83c-032f-4abf-90a5-996dba7bb384 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.669982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2555a83c-032f-4abf-90a5-996dba7bb384 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048179 Jun 17 13:16:10.670598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1183/2272] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:11.151625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:11.152246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:11.159274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.159722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.160511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.160947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.230943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:11.242855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-613a5205-0786-458a-a6a2-1d613074fbac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094995 Jun 17 13:16:11.243617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1090/2273] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:11.400392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a7c8af1e-b4ab-4a7e-ad0c-acb8e99e4e27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:11.401731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a7c8af1e-b4ab-4a7e-ad0c-acb8e99e4e27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:11.409975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7c8af1e-b4ab-4a7e-ad0c-acb8e99e4e27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.410403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7c8af1e-b4ab-4a7e-ad0c-acb8e99e4e27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.411159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7c8af1e-b4ab-4a7e-ad0c-acb8e99e4e27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.411642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7c8af1e-b4ab-4a7e-ad0c-acb8e99e4e27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.443382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a7c8af1e-b4ab-4a7e-ad0c-acb8e99e4e27 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049838 Jun 17 13:16:11.443950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1184/2274] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:11 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:11.685337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aefed14f-ebe0-4e69-a275-f99bbdf3e071 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:11.686750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aefed14f-ebe0-4e69-a275-f99bbdf3e071 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:11.695931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aefed14f-ebe0-4e69-a275-f99bbdf3e071 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.696674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aefed14f-ebe0-4e69-a275-f99bbdf3e071 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.697930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aefed14f-ebe0-4e69-a275-f99bbdf3e071 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.698648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aefed14f-ebe0-4e69-a275-f99bbdf3e071 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.731179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aefed14f-ebe0-4e69-a275-f99bbdf3e071 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052693 Jun 17 13:16:11.731778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1091/2275] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:12.265159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:12.265927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:12.275425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.276025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.277025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.277602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.342629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:12.350553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c2a9b32-019e-4cde-ab59-b2b31701599c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090667 Jun 17 13:16:12.351112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1185/2276] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:12.457873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-63025d37-fd5a-42da-ad21-2e5dce11011e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:12.458705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-63025d37-fd5a-42da-ad21-2e5dce11011e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:12.466015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63025d37-fd5a-42da-ad21-2e5dce11011e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.466467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63025d37-fd5a-42da-ad21-2e5dce11011e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.467227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63025d37-fd5a-42da-ad21-2e5dce11011e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.467696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63025d37-fd5a-42da-ad21-2e5dce11011e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.499414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-63025d37-fd5a-42da-ad21-2e5dce11011e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046912 Jun 17 13:16:12.500373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1092/2277] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:12 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:12.744389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0ed0d156-6351-411b-a74c-e348b3133738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:12.745404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0ed0d156-6351-411b-a74c-e348b3133738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:12.753304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ed0d156-6351-411b-a74c-e348b3133738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.753746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ed0d156-6351-411b-a74c-e348b3133738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.754507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ed0d156-6351-411b-a74c-e348b3133738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.754936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ed0d156-6351-411b-a74c-e348b3133738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.784955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0ed0d156-6351-411b-a74c-e348b3133738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Jun 17 13:16:12.785532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1186/2278] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:13.371584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:13.372484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:13.384069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.384805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.386008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.386762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.456042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:13.464793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fbf36a16-6796-4221-905d-683bf574acbf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099804 Jun 17 13:16:13.465418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1093/2279] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:13.511900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43b41b84-1a3b-4caf-bf7d-a1cea5ebce49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:13.512854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43b41b84-1a3b-4caf-bf7d-a1cea5ebce49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:13.519894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43b41b84-1a3b-4caf-bf7d-a1cea5ebce49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.520377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43b41b84-1a3b-4caf-bf7d-a1cea5ebce49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.521135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43b41b84-1a3b-4caf-bf7d-a1cea5ebce49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.521576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43b41b84-1a3b-4caf-bf7d-a1cea5ebce49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.551405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43b41b84-1a3b-4caf-bf7d-a1cea5ebce49 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Jun 17 13:16:13.551991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1187/2280] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:13.801132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c1e13a78-36a5-4f14-aad4-0097f439f180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:13.802219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c1e13a78-36a5-4f14-aad4-0097f439f180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:13.809475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e13a78-36a5-4f14-aad4-0097f439f180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.809990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e13a78-36a5-4f14-aad4-0097f439f180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.810875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e13a78-36a5-4f14-aad4-0097f439f180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.811408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c1e13a78-36a5-4f14-aad4-0097f439f180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.844632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c1e13a78-36a5-4f14-aad4-0097f439f180 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050464 Jun 17 13:16:13.845177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1094/2281] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:14.486497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:14.487662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:14.498112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.498846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.500525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.501224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.562771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-25c5b2c0-3f63-4c1f-856f-6058de5b1e43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:14.563816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-25c5b2c0-3f63-4c1f-856f-6058de5b1e43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:14.564230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:14.570911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25c5b2c0-3f63-4c1f-856f-6058de5b1e43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.571509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25c5b2c0-3f63-4c1f-856f-6058de5b1e43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.572312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25c5b2c0-3f63-4c1f-856f-6058de5b1e43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.572878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25c5b2c0-3f63-4c1f-856f-6058de5b1e43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.573046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4017f659-4e85-400f-9f73-6bb4978ef410 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093224 Jun 17 13:16:14.573568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1188/2282] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:14.604424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-25c5b2c0-3f63-4c1f-856f-6058de5b1e43 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Jun 17 13:16:14.604968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1095/2283] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:14 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:14.857528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bdd0cb82-bddf-495d-a39d-446b95e05566 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:14.858640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bdd0cb82-bddf-495d-a39d-446b95e05566 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:14.865767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0cb82-bddf-495d-a39d-446b95e05566 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.866213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0cb82-bddf-495d-a39d-446b95e05566 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.866973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0cb82-bddf-495d-a39d-446b95e05566 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.867406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0cb82-bddf-495d-a39d-446b95e05566 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.897060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bdd0cb82-bddf-495d-a39d-446b95e05566 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Jun 17 13:16:14.897610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1189/2284] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:15.594114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:15.594891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:15.605520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.606209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.607433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.608103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.616924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-54260124-1264-4fc0-877a-8db2fb523f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:15.617929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-54260124-1264-4fc0-877a-8db2fb523f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:15.625243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54260124-1264-4fc0-877a-8db2fb523f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.625691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54260124-1264-4fc0-877a-8db2fb523f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.626444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54260124-1264-4fc0-877a-8db2fb523f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.626877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54260124-1264-4fc0-877a-8db2fb523f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.657750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-54260124-1264-4fc0-877a-8db2fb523f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Jun 17 13:16:15.658328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1190/2285] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:15 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:15.674042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:15.685496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a31baf3a-e983-402d-837f-f8878b8a46ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097701 Jun 17 13:16:15.686274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1096/2286] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:15.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cc466c5b-961d-44c1-9664-041762f2dda3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:15.910148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cc466c5b-961d-44c1-9664-041762f2dda3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:15.917058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc466c5b-961d-44c1-9664-041762f2dda3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.917510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc466c5b-961d-44c1-9664-041762f2dda3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.918270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc466c5b-961d-44c1-9664-041762f2dda3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.918702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc466c5b-961d-44c1-9664-041762f2dda3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.949489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cc466c5b-961d-44c1-9664-041762f2dda3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Jun 17 13:16:15.950027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1191/2287] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:16.670714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6ffb5846-3ae1-474c-986c-8eb7da3196bc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:16.671669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6ffb5846-3ae1-474c-986c-8eb7da3196bc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:16.678674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ffb5846-3ae1-474c-986c-8eb7da3196bc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.679207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ffb5846-3ae1-474c-986c-8eb7da3196bc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.679988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ffb5846-3ae1-474c-986c-8eb7da3196bc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.680415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ffb5846-3ae1-474c-986c-8eb7da3196bc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.704346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:16.704938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:16.710686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6ffb5846-3ae1-474c-986c-8eb7da3196bc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Jun 17 13:16:16.711257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1097/2288] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:16 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:16.712116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.712568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.713321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.713743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.780931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:16.792966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-943d8bb4-287c-420c-8cd4-26ced610bfcb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092217 Jun 17 13:16:16.793732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1192/2289] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:16.962240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-005258d3-3c7b-4c5b-ac08-4668d9b8c163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:16.963068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-005258d3-3c7b-4c5b-ac08-4668d9b8c163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:16.969464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-005258d3-3c7b-4c5b-ac08-4668d9b8c163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.969867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-005258d3-3c7b-4c5b-ac08-4668d9b8c163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.970747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-005258d3-3c7b-4c5b-ac08-4668d9b8c163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.971149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-005258d3-3c7b-4c5b-ac08-4668d9b8c163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.001423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-005258d3-3c7b-4c5b-ac08-4668d9b8c163 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Jun 17 13:16:17.001933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1098/2290] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:17.727872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cea75253-4ee0-4de6-95b4-33d7be3395ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:17.729342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cea75253-4ee0-4de6-95b4-33d7be3395ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:17.740563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea75253-4ee0-4de6-95b4-33d7be3395ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.741004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea75253-4ee0-4de6-95b4-33d7be3395ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.741754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea75253-4ee0-4de6-95b4-33d7be3395ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.742269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cea75253-4ee0-4de6-95b4-33d7be3395ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.774378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cea75253-4ee0-4de6-95b4-33d7be3395ca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054135 Jun 17 13:16:17.774925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1193/2291] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:17.813262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:17.813907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:17.821046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.821501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.822261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.822694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.889533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:17.897427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-71f1586e-fe26-4a50-bf96-7afe8ad0325c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088214 Jun 17 13:16:17.897991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1099/2292] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:18.014500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dc4fd6d0-af70-4478-a699-f63dcc40298d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:18.015427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dc4fd6d0-af70-4478-a699-f63dcc40298d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:18.021832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc4fd6d0-af70-4478-a699-f63dcc40298d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.022257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc4fd6d0-af70-4478-a699-f63dcc40298d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.023008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc4fd6d0-af70-4478-a699-f63dcc40298d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.023479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc4fd6d0-af70-4478-a699-f63dcc40298d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.053312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dc4fd6d0-af70-4478-a699-f63dcc40298d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042759 Jun 17 13:16:18.053940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1194/2293] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:18.787436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d3ccfe20-cb5d-497a-ba68-1ad54cd9f089 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:18.788842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d3ccfe20-cb5d-497a-ba68-1ad54cd9f089 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:18.798077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe20-cb5d-497a-ba68-1ad54cd9f089 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.798784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe20-cb5d-497a-ba68-1ad54cd9f089 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.800087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe20-cb5d-497a-ba68-1ad54cd9f089 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.800641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3ccfe20-cb5d-497a-ba68-1ad54cd9f089 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.832762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d3ccfe20-cb5d-497a-ba68-1ad54cd9f089 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050094 Jun 17 13:16:18.834180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1100/2294] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:18 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:18.915141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:18.915788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:18.924710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.925148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.925912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.926646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.947499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:18.996141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:19.004696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8236f542-8bfb-4f0a-b494-d533399c9615 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094024 Jun 17 13:16:19.005383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1195/2295] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:19.065906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-07b1f786-5290-42d6-8498-273fa531d30f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:19.067086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-07b1f786-5290-42d6-8498-273fa531d30f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:19.073854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07b1f786-5290-42d6-8498-273fa531d30f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.074323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07b1f786-5290-42d6-8498-273fa531d30f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.075097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07b1f786-5290-42d6-8498-273fa531d30f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.075538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07b1f786-5290-42d6-8498-273fa531d30f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.107054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-07b1f786-5290-42d6-8498-273fa531d30f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Jun 17 13:16:19.107654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1101/2296] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:19.846255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ff336fa-fc96-4803-a6d9-3021d4720188 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:19.847181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5ff336fa-fc96-4803-a6d9-3021d4720188 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:19.854017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ff336fa-fc96-4803-a6d9-3021d4720188 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.854464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ff336fa-fc96-4803-a6d9-3021d4720188 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.855236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ff336fa-fc96-4803-a6d9-3021d4720188 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.855703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ff336fa-fc96-4803-a6d9-3021d4720188 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.886802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5ff336fa-fc96-4803-a6d9-3021d4720188 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Jun 17 13:16:19.887390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1196/2297] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:19 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:20.023735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:20.024363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:20.031292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.031771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.032534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.032971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.099828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:20.103338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:20.108276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c6eb2ba0-e427-4af0-b405-fe18c9128cbe tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089097 Jun 17 13:16:20.109088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1102/2298] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:20 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:20.118254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-73adc4cc-c0f9-43ae-9029-5b4b9af6dfd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:20.119180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-73adc4cc-c0f9-43ae-9029-5b4b9af6dfd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:20.126553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73adc4cc-c0f9-43ae-9029-5b4b9af6dfd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.126983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73adc4cc-c0f9-43ae-9029-5b4b9af6dfd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.127790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73adc4cc-c0f9-43ae-9029-5b4b9af6dfd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.128221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73adc4cc-c0f9-43ae-9029-5b4b9af6dfd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.157666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-73adc4cc-c0f9-43ae-9029-5b4b9af6dfd6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Jun 17 13:16:20.158205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1197/2299] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:20.903069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7de95029-63cd-4914-96f7-56ffe9b64259 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:20.904602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7de95029-63cd-4914-96f7-56ffe9b64259 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:20.913644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7de95029-63cd-4914-96f7-56ffe9b64259 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.914087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7de95029-63cd-4914-96f7-56ffe9b64259 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.914839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7de95029-63cd-4914-96f7-56ffe9b64259 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.915272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7de95029-63cd-4914-96f7-56ffe9b64259 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.944027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7de95029-63cd-4914-96f7-56ffe9b64259 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047597 Jun 17 13:16:20.944574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1103/2300] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:20 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:21.129705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:21.130327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:21.137407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.137857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.138809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.139248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.170012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-20510066-3ffa-494e-9645-fcb9a9d8d952 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:21.170849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-20510066-3ffa-494e-9645-fcb9a9d8d952 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:21.177926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20510066-3ffa-494e-9645-fcb9a9d8d952 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.178368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20510066-3ffa-494e-9645-fcb9a9d8d952 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.179133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20510066-3ffa-494e-9645-fcb9a9d8d952 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.179606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20510066-3ffa-494e-9645-fcb9a9d8d952 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.201393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:21.209442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-83ff3151-ee83-4a41-ab43-a1d7fedc058d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086577 Jun 17 13:16:21.209749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-20510066-3ffa-494e-9645-fcb9a9d8d952 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Jun 17 13:16:21.210014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1198/2301] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:21 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:21.210527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1104/2302] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:21.960785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f310b515-cf45-453a-ae3a-c8b371576497 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:21.962307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f310b515-cf45-453a-ae3a-c8b371576497 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:21.972736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f310b515-cf45-453a-ae3a-c8b371576497 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.973691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f310b515-cf45-453a-ae3a-c8b371576497 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.974753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f310b515-cf45-453a-ae3a-c8b371576497 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.975185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f310b515-cf45-453a-ae3a-c8b371576497 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:22.005489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f310b515-cf45-453a-ae3a-c8b371576497 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052119 Jun 17 13:16:22.006039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1199/2303] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:22.221109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-75e77cb6-7d3e-4e59-87b8-49853b7614e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:22.222026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-75e77cb6-7d3e-4e59-87b8-49853b7614e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:22.226038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:22.226641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:22.229008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75e77cb6-7d3e-4e59-87b8-49853b7614e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:22.229478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75e77cb6-7d3e-4e59-87b8-49853b7614e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:22.230277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75e77cb6-7d3e-4e59-87b8-49853b7614e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:22.230714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75e77cb6-7d3e-4e59-87b8-49853b7614e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:22.233121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:22.233553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:22.234332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:22.234757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:22.262247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-75e77cb6-7d3e-4e59-87b8-49853b7614e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Jun 17 13:16:22.262811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1105/2304] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:22.296782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:22.304655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fbe6e231-363b-4007-8975-2821149b6233 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.082471 Jun 17 13:16:22.305222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1200/2305] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:16:23.021380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4aba0af7-440a-43c2-91ad-f4a7e5430151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:23.022406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4aba0af7-440a-43c2-91ad-f4a7e5430151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:23.029232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4aba0af7-440a-43c2-91ad-f4a7e5430151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.029704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4aba0af7-440a-43c2-91ad-f4a7e5430151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.030501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4aba0af7-440a-43c2-91ad-f4a7e5430151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.030957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4aba0af7-440a-43c2-91ad-f4a7e5430151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.061762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4aba0af7-440a-43c2-91ad-f4a7e5430151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Jun 17 13:16:23.062339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1106/2306] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:23 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:23.279000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-072a2fda-3e87-4cf4-b6f8-c8651bb78ea4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:23.280417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-072a2fda-3e87-4cf4-b6f8-c8651bb78ea4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:23.290153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-072a2fda-3e87-4cf4-b6f8-c8651bb78ea4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.290593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-072a2fda-3e87-4cf4-b6f8-c8651bb78ea4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.291337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-072a2fda-3e87-4cf4-b6f8-c8651bb78ea4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.291795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-072a2fda-3e87-4cf4-b6f8-c8651bb78ea4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.321879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-072a2fda-3e87-4cf4-b6f8-c8651bb78ea4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049578 Jun 17 13:16:23.322128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:23.322582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1201/2307] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:23.322744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:23.329583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.330033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.330786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.331218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.401819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:23.409978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5abe213-4b35-4361-9e06-976d5476bd5d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091979 Jun 17 13:16:23.410546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1107/2308] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:24.074446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1a87369-a011-476d-8b24-5cd6d14b771f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:24.075386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1a87369-a011-476d-8b24-5cd6d14b771f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:24.081615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a87369-a011-476d-8b24-5cd6d14b771f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.082057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a87369-a011-476d-8b24-5cd6d14b771f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.082798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a87369-a011-476d-8b24-5cd6d14b771f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.083398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1a87369-a011-476d-8b24-5cd6d14b771f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.114071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1a87369-a011-476d-8b24-5cd6d14b771f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Jun 17 13:16:24.115250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1202/2309] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:24.338889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e096ba5f-0c2f-4ec7-af98-a6bbf2943940 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:24.340397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e096ba5f-0c2f-4ec7-af98-a6bbf2943940 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:24.351894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e096ba5f-0c2f-4ec7-af98-a6bbf2943940 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.352637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e096ba5f-0c2f-4ec7-af98-a6bbf2943940 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.353932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e096ba5f-0c2f-4ec7-af98-a6bbf2943940 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.354650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e096ba5f-0c2f-4ec7-af98-a6bbf2943940 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.388727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e096ba5f-0c2f-4ec7-af98-a6bbf2943940 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057243 Jun 17 13:16:24.389657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1108/2310] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:24.429178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:24.429761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:24.436384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.436837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.437586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.438018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.506583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:24.518452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eff481df-c9b6-40ab-8a6a-13194e62c48b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094429 Jun 17 13:16:24.519271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1203/2311] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:25.127182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-64c9e51e-4623-4b5e-b35c-a2d55f963c87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:25.128158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-64c9e51e-4623-4b5e-b35c-a2d55f963c87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:25.134780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64c9e51e-4623-4b5e-b35c-a2d55f963c87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.135220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64c9e51e-4623-4b5e-b35c-a2d55f963c87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.136015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64c9e51e-4623-4b5e-b35c-a2d55f963c87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.136444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-64c9e51e-4623-4b5e-b35c-a2d55f963c87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.167095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-64c9e51e-4623-4b5e-b35c-a2d55f963c87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Jun 17 13:16:25.167689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1109/2312] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:25 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:25.404042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-584de21e-e675-41e9-8545-b04f951fbdef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:25.405350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-584de21e-e675-41e9-8545-b04f951fbdef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:25.414507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-584de21e-e675-41e9-8545-b04f951fbdef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.415107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-584de21e-e675-41e9-8545-b04f951fbdef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.416311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-584de21e-e675-41e9-8545-b04f951fbdef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.416899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-584de21e-e675-41e9-8545-b04f951fbdef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.448356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-584de21e-e675-41e9-8545-b04f951fbdef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050557 Jun 17 13:16:25.449074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1204/2313] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:25 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:25.540651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:25.541861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:25.552957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.553696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.554944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.555714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.635406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:25.647618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1faf1380-17cf-4c13-b677-677cb0200c58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.113183 Jun 17 13:16:25.648384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1110/2314] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:26.183308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0905bd1f-8f5b-4abd-b5de-d83b5ff869a6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:26.184738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0905bd1f-8f5b-4abd-b5de-d83b5ff869a6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:26.195140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0905bd1f-8f5b-4abd-b5de-d83b5ff869a6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.195949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0905bd1f-8f5b-4abd-b5de-d83b5ff869a6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.197197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0905bd1f-8f5b-4abd-b5de-d83b5ff869a6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.197917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0905bd1f-8f5b-4abd-b5de-d83b5ff869a6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.238316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0905bd1f-8f5b-4abd-b5de-d83b5ff869a6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061684 Jun 17 13:16:26.238847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1205/2315] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:26.464475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d280259c-5500-4df0-b279-b29bcb1700b3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:26.465669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d280259c-5500-4df0-b279-b29bcb1700b3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:26.472440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d280259c-5500-4df0-b279-b29bcb1700b3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.472888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d280259c-5500-4df0-b279-b29bcb1700b3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.473725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d280259c-5500-4df0-b279-b29bcb1700b3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.474166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d280259c-5500-4df0-b279-b29bcb1700b3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.504094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d280259c-5500-4df0-b279-b29bcb1700b3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046354 Jun 17 13:16:26.504649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1111/2316] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:26.665312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:26.665911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:26.672980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.673444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.674201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.674632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.738325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:26.746308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e11b172-5485-4a67-8004-5e2def0d11d1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085053 Jun 17 13:16:26.746878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1206/2317] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:27.255407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3dddcf4-c1ae-4314-96eb-360cf403d234 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:27.256978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3dddcf4-c1ae-4314-96eb-360cf403d234 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:27.268850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3dddcf4-c1ae-4314-96eb-360cf403d234 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.269599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3dddcf4-c1ae-4314-96eb-360cf403d234 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.270820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3dddcf4-c1ae-4314-96eb-360cf403d234 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.271617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3dddcf4-c1ae-4314-96eb-360cf403d234 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.313937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3dddcf4-c1ae-4314-96eb-360cf403d234 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066101 Jun 17 13:16:27.314496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1112/2318] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:27.517354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dbf7a948-0314-4df7-8d4e-7fa955dbe5c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:27.518747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dbf7a948-0314-4df7-8d4e-7fa955dbe5c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:27.528057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbf7a948-0314-4df7-8d4e-7fa955dbe5c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.528682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbf7a948-0314-4df7-8d4e-7fa955dbe5c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.529621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbf7a948-0314-4df7-8d4e-7fa955dbe5c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.530485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbf7a948-0314-4df7-8d4e-7fa955dbe5c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.564814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dbf7a948-0314-4df7-8d4e-7fa955dbe5c5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052044 Jun 17 13:16:27.565368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1207/2319] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:27.765261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:27.765872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:27.775270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.775749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.779171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.779630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.855451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:27.863582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc2e349e-362b-4e90-9143-ad89f0a029d6 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.102256 Jun 17 13:16:27.864150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1113/2320] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:28.331219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fc4db7a8-b71d-4bd9-b2e9-4a4c1fbad17d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:28.332253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fc4db7a8-b71d-4bd9-b2e9-4a4c1fbad17d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:28.339666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc4db7a8-b71d-4bd9-b2e9-4a4c1fbad17d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.340133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc4db7a8-b71d-4bd9-b2e9-4a4c1fbad17d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.340923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc4db7a8-b71d-4bd9-b2e9-4a4c1fbad17d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.341375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc4db7a8-b71d-4bd9-b2e9-4a4c1fbad17d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.374042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fc4db7a8-b71d-4bd9-b2e9-4a4c1fbad17d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048948 Jun 17 13:16:28.374852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1208/2321] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:28.582342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bb4e1272-e105-4b41-8f5d-8870c194d9e0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:28.583784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bb4e1272-e105-4b41-8f5d-8870c194d9e0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:28.594908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e1272-e105-4b41-8f5d-8870c194d9e0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.596016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e1272-e105-4b41-8f5d-8870c194d9e0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.596758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e1272-e105-4b41-8f5d-8870c194d9e0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.597186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb4e1272-e105-4b41-8f5d-8870c194d9e0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.628859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bb4e1272-e105-4b41-8f5d-8870c194d9e0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054271 Jun 17 13:16:28.629332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1114/2322] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:28.882414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:28.882931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:28.892647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.893094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.894657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.895096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.960271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:28.968235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a3e18753-4ec5-4e21-b29d-57b4ab2ea247 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090200 Jun 17 13:16:28.968796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1209/2323] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:16:29.390891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc927839-cf2e-4052-9f2f-6d39dbbfe23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:29.392180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc927839-cf2e-4052-9f2f-6d39dbbfe23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:29.400670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc927839-cf2e-4052-9f2f-6d39dbbfe23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.401272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc927839-cf2e-4052-9f2f-6d39dbbfe23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.402286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc927839-cf2e-4052-9f2f-6d39dbbfe23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.402861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc927839-cf2e-4052-9f2f-6d39dbbfe23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.434776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc927839-cf2e-4052-9f2f-6d39dbbfe23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049199 Jun 17 13:16:29.435339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1115/2324] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:29 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:29.647182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-73f3a1fd-15da-449c-86e1-5f6ce7b353ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:29.648567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-73f3a1fd-15da-449c-86e1-5f6ce7b353ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:29.660153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73f3a1fd-15da-449c-86e1-5f6ce7b353ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.660896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73f3a1fd-15da-449c-86e1-5f6ce7b353ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.662138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73f3a1fd-15da-449c-86e1-5f6ce7b353ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.662898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73f3a1fd-15da-449c-86e1-5f6ce7b353ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.697522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-73f3a1fd-15da-449c-86e1-5f6ce7b353ab tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057390 Jun 17 13:16:29.698056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1210/2325] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:29.989861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:29.990744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:30.002027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.002759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.004056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.004490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.076500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:30.086412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-259d81cd-daf1-4b4a-9538-d4a90902f5d5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.103048 Jun 17 13:16:30.087270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1116/2326] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:30.450785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-241ba66c-eef3-46ae-9aff-4a293aaedbc0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:30.452346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-241ba66c-eef3-46ae-9aff-4a293aaedbc0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:30.461439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-241ba66c-eef3-46ae-9aff-4a293aaedbc0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.461893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-241ba66c-eef3-46ae-9aff-4a293aaedbc0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.462636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-241ba66c-eef3-46ae-9aff-4a293aaedbc0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.463066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-241ba66c-eef3-46ae-9aff-4a293aaedbc0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.492550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-241ba66c-eef3-46ae-9aff-4a293aaedbc0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Jun 17 13:16:30.493097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1211/2327] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:30 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:30.714996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed64d1b3-88ec-4e27-aa87-dce2ad5f270e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:30.716301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed64d1b3-88ec-4e27-aa87-dce2ad5f270e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:30.725378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed64d1b3-88ec-4e27-aa87-dce2ad5f270e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.725827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed64d1b3-88ec-4e27-aa87-dce2ad5f270e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.726588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed64d1b3-88ec-4e27-aa87-dce2ad5f270e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.727021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed64d1b3-88ec-4e27-aa87-dce2ad5f270e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.756649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed64d1b3-88ec-4e27-aa87-dce2ad5f270e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047957 Jun 17 13:16:30.757228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1117/2328] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:30 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:31.104828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:31.105457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:31.112629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.113105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.113897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.114351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.118585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:31.180730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:31.190348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ac3f220c-58a8-4505-9c15-ce01ea084287 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.089233 Jun 17 13:16:31.191303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1212/2329] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:31.506741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c595b587-e0af-430e-8f2a-019c365e3932 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:31.507715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c595b587-e0af-430e-8f2a-019c365e3932 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:31.514764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c595b587-e0af-430e-8f2a-019c365e3932 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.515298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c595b587-e0af-430e-8f2a-019c365e3932 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.516086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c595b587-e0af-430e-8f2a-019c365e3932 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.516523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c595b587-e0af-430e-8f2a-019c365e3932 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.552038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c595b587-e0af-430e-8f2a-019c365e3932 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051105 Jun 17 13:16:31.552738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1118/2330] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:31.772667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-64eb4a8c-9987-48a9-9e4e-b056a587db1f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:31.773580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-64eb4a8c-9987-48a9-9e4e-b056a587db1f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:31.779846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64eb4a8c-9987-48a9-9e4e-b056a587db1f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.780291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64eb4a8c-9987-48a9-9e4e-b056a587db1f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.781038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64eb4a8c-9987-48a9-9e4e-b056a587db1f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.781469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-64eb4a8c-9987-48a9-9e4e-b056a587db1f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.810330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-64eb4a8c-9987-48a9-9e4e-b056a587db1f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Jun 17 13:16:31.810879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1213/2331] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:32.216998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:32.218010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:32.227645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.228095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.228884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.229311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.247403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:32.306997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:32.318306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5a0b7aaa-350c-4b93-9c2e-d95546989464 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.108133 Jun 17 13:16:32.319119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1119/2332] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:32.566985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-90f51a56-d368-4655-82f8-7a6f13029010 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:32.568119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-90f51a56-d368-4655-82f8-7a6f13029010 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:32.571544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=86 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:32.578690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90f51a56-d368-4655-82f8-7a6f13029010 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.579129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90f51a56-d368-4655-82f8-7a6f13029010 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.579905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90f51a56-d368-4655-82f8-7a6f13029010 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.580320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-90f51a56-d368-4655-82f8-7a6f13029010 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.610936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-90f51a56-d368-4655-82f8-7a6f13029010 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050448 Jun 17 13:16:32.611541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1214/2333] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:32 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:32.825374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b7ccd04a-d045-462f-8b87-cde487e4dcef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:32.826288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b7ccd04a-d045-462f-8b87-cde487e4dcef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:32.833652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7ccd04a-d045-462f-8b87-cde487e4dcef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.834122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7ccd04a-d045-462f-8b87-cde487e4dcef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.835019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7ccd04a-d045-462f-8b87-cde487e4dcef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.835511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7ccd04a-d045-462f-8b87-cde487e4dcef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.866061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b7ccd04a-d045-462f-8b87-cde487e4dcef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046382 Jun 17 13:16:32.866617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1120/2334] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:33.339681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:33.340294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:33.346825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.347277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.348063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.348497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.421253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:33.432738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-508bc373-756c-488a-a914-8a3e6c168f07 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098987 Jun 17 13:16:33.433304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1215/2335] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:33.623622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ed6ec3a-e1f2-4c04-9767-de95c7ff19e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:33.624923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ed6ec3a-e1f2-4c04-9767-de95c7ff19e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:33.631138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ed6ec3a-e1f2-4c04-9767-de95c7ff19e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.631614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ed6ec3a-e1f2-4c04-9767-de95c7ff19e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.632361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ed6ec3a-e1f2-4c04-9767-de95c7ff19e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.632784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ed6ec3a-e1f2-4c04-9767-de95c7ff19e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.664845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ed6ec3a-e1f2-4c04-9767-de95c7ff19e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045697 Jun 17 13:16:33.665311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1121/2336] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:33 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:33.882595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f7be1ab8-403d-49fe-ae49-83b7cda1e635 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:33.884140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f7be1ab8-403d-49fe-ae49-83b7cda1e635 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:33.895421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7be1ab8-403d-49fe-ae49-83b7cda1e635 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.896166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7be1ab8-403d-49fe-ae49-83b7cda1e635 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.897418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7be1ab8-403d-49fe-ae49-83b7cda1e635 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.898140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7be1ab8-403d-49fe-ae49-83b7cda1e635 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.929098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f7be1ab8-403d-49fe-ae49-83b7cda1e635 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053239 Jun 17 13:16:33.929567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1216/2337] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:34.450245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:34.450853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:34.459855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.460573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.461814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.462731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.531496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:34.539802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b98321f7-23f9-4b10-8924-281648412d42 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093766 Jun 17 13:16:34.540373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1122/2338] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:34.677234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5a210df9-dbbb-41a8-89a3-6c39486128c3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:34.678160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5a210df9-dbbb-41a8-89a3-6c39486128c3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:34.684931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a210df9-dbbb-41a8-89a3-6c39486128c3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.685382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a210df9-dbbb-41a8-89a3-6c39486128c3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.686143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a210df9-dbbb-41a8-89a3-6c39486128c3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.686577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a210df9-dbbb-41a8-89a3-6c39486128c3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.715811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5a210df9-dbbb-41a8-89a3-6c39486128c3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042569 Jun 17 13:16:34.716275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1217/2339] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:34 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:34.946654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cc96be57-908a-430d-a939-b534c7c8dd03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:34.948266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cc96be57-908a-430d-a939-b534c7c8dd03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:34.955193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc96be57-908a-430d-a939-b534c7c8dd03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.955667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc96be57-908a-430d-a939-b534c7c8dd03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.956432 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc96be57-908a-430d-a939-b534c7c8dd03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.956853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc96be57-908a-430d-a939-b534c7c8dd03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.987624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cc96be57-908a-430d-a939-b534c7c8dd03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047754 Jun 17 13:16:34.988122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1123/2340] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:35.560402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:35.561258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:35.568259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.568697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.569453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.569847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.636392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:35.644411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-daaf731d-1a19-44ac-b25b-735a667cc09d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090141 Jun 17 13:16:35.644971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1218/2341] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:35.730626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-efe1eaf0-b2fc-4576-bfa2-ac0b5fd2c7b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:35.731582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-efe1eaf0-b2fc-4576-bfa2-ac0b5fd2c7b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:35.738724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-efe1eaf0-b2fc-4576-bfa2-ac0b5fd2c7b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.739173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-efe1eaf0-b2fc-4576-bfa2-ac0b5fd2c7b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.739962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-efe1eaf0-b2fc-4576-bfa2-ac0b5fd2c7b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.740396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-efe1eaf0-b2fc-4576-bfa2-ac0b5fd2c7b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.772281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-efe1eaf0-b2fc-4576-bfa2-ac0b5fd2c7b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047943 Jun 17 13:16:35.772868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1124/2342] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:35 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:36.001494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fa7a7fa3-1d1a-4048-9c37-88211491cfaf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:36.002882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fa7a7fa3-1d1a-4048-9c37-88211491cfaf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:36.011435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa7a7fa3-1d1a-4048-9c37-88211491cfaf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.012046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa7a7fa3-1d1a-4048-9c37-88211491cfaf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.013158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa7a7fa3-1d1a-4048-9c37-88211491cfaf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.013665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa7a7fa3-1d1a-4048-9c37-88211491cfaf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.045479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fa7a7fa3-1d1a-4048-9c37-88211491cfaf tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049553 Jun 17 13:16:36.046313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1219/2343] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:36.662212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:36.663182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:36.670289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.670862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.672066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.672498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.744638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:36.753523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-80784b09-4248-42ab-83a2-7196eff6542a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095323 Jun 17 13:16:36.754118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1125/2344] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:36.790211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3c88bd73-e7f1-4c23-b1f7-15791871f0ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:36.791344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3c88bd73-e7f1-4c23-b1f7-15791871f0ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:36.801006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c88bd73-e7f1-4c23-b1f7-15791871f0ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.801467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c88bd73-e7f1-4c23-b1f7-15791871f0ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.802360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c88bd73-e7f1-4c23-b1f7-15791871f0ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.802884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3c88bd73-e7f1-4c23-b1f7-15791871f0ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.835903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3c88bd73-e7f1-4c23-b1f7-15791871f0ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052070 Jun 17 13:16:36.836443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1220/2345] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:36 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:37.059407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62786aea-5aee-4f50-ade5-138ee7c0258a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:37.060337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62786aea-5aee-4f50-ade5-138ee7c0258a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:37.068229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62786aea-5aee-4f50-ade5-138ee7c0258a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.068682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62786aea-5aee-4f50-ade5-138ee7c0258a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.069587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62786aea-5aee-4f50-ade5-138ee7c0258a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.069980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62786aea-5aee-4f50-ade5-138ee7c0258a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.106736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62786aea-5aee-4f50-ade5-138ee7c0258a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051348 Jun 17 13:16:37.107292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1126/2346] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:37.775446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:37.776466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:37.784656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.785103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.785862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.786298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.848913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a5782e3-6599-40bf-a056-21a41fd61a1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:37.849831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a5782e3-6599-40bf-a056-21a41fd61a1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:37.857182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a5782e3-6599-40bf-a056-21a41fd61a1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.857182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a5782e3-6599-40bf-a056-21a41fd61a1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.857850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a5782e3-6599-40bf-a056-21a41fd61a1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.858273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a5782e3-6599-40bf-a056-21a41fd61a1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.859348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:37.867185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d83932f8-2782-40a3-8674-e4baedba7b9e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098395 Jun 17 13:16:37.867781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1221/2347] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:37.888932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a5782e3-6599-40bf-a056-21a41fd61a1a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Jun 17 13:16:37.889477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1127/2348] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:37 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:38.119201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e70d191b-5434-4385-a1bd-3e21eb0933ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:38.120152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e70d191b-5434-4385-a1bd-3e21eb0933ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:38.129178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e70d191b-5434-4385-a1bd-3e21eb0933ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.129856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e70d191b-5434-4385-a1bd-3e21eb0933ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.131074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e70d191b-5434-4385-a1bd-3e21eb0933ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.131760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e70d191b-5434-4385-a1bd-3e21eb0933ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.164910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e70d191b-5434-4385-a1bd-3e21eb0933ef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049764 Jun 17 13:16:38.165468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1222/2349] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:38.889709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:38.890708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:38.898653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.899102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.899899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.900379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.901326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c73a2cea-fb78-4963-b94e-320c1fc11bec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:38.902259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c73a2cea-fb78-4963-b94e-320c1fc11bec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:38.909267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73a2cea-fb78-4963-b94e-320c1fc11bec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.909714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73a2cea-fb78-4963-b94e-320c1fc11bec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.910471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73a2cea-fb78-4963-b94e-320c1fc11bec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.910906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c73a2cea-fb78-4963-b94e-320c1fc11bec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.942786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c73a2cea-fb78-4963-b94e-320c1fc11bec tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Jun 17 13:16:38.943440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1223/2350] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:38 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:38.963238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:38.971849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f449e696-a120-4f94-a03b-27d1899002f1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088658 Jun 17 13:16:38.972403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1128/2351] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:39.182738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2787e1e8-6ebd-4ab6-84fa-37c37446767c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:39.184052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2787e1e8-6ebd-4ab6-84fa-37c37446767c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:39.192330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2787e1e8-6ebd-4ab6-84fa-37c37446767c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.192843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2787e1e8-6ebd-4ab6-84fa-37c37446767c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.193587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2787e1e8-6ebd-4ab6-84fa-37c37446767c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.194022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2787e1e8-6ebd-4ab6-84fa-37c37446767c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.223959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2787e1e8-6ebd-4ab6-84fa-37c37446767c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047538 Jun 17 13:16:39.224524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1224/2352] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:39.954505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-543ecc1c-51f8-4d3a-8ae6-87543edda89d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:39.955476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-543ecc1c-51f8-4d3a-8ae6-87543edda89d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:39.958301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=84 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:39.964145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-543ecc1c-51f8-4d3a-8ae6-87543edda89d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.964581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-543ecc1c-51f8-4d3a-8ae6-87543edda89d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.965380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-543ecc1c-51f8-4d3a-8ae6-87543edda89d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.965808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-543ecc1c-51f8-4d3a-8ae6-87543edda89d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.989377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:39.989976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:39.996739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.997185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.997952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.998382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:40.002502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-543ecc1c-51f8-4d3a-8ae6-87543edda89d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051990 Jun 17 13:16:40.003048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1129/2353] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:39 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:40.062753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:40.072193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4aad8f68-13c8-43b5-8c20-f73d886a86fd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086913 Jun 17 13:16:40.072994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1225/2354] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:40.238222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0f63bd7c-adcd-406d-bff3-db986e470037 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:40.239525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0f63bd7c-adcd-406d-bff3-db986e470037 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:40.248603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f63bd7c-adcd-406d-bff3-db986e470037 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:40.249211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f63bd7c-adcd-406d-bff3-db986e470037 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:40.250745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f63bd7c-adcd-406d-bff3-db986e470037 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:40.251336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f63bd7c-adcd-406d-bff3-db986e470037 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:40.282450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0f63bd7c-adcd-406d-bff3-db986e470037 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Jun 17 13:16:40.282996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1130/2355] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:41.018255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ac40bc72-d80f-401d-9bcc-6a56d24ca26e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:41.019816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ac40bc72-d80f-401d-9bcc-6a56d24ca26e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:41.031164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac40bc72-d80f-401d-9bcc-6a56d24ca26e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.031904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac40bc72-d80f-401d-9bcc-6a56d24ca26e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.033063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac40bc72-d80f-401d-9bcc-6a56d24ca26e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.033727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac40bc72-d80f-401d-9bcc-6a56d24ca26e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.064296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ac40bc72-d80f-401d-9bcc-6a56d24ca26e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052242 Jun 17 13:16:41.064856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1226/2356] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:41 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:41.096972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:41.097890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:41.105169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.105623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.106404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.106868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.175210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:41.184706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a2763daf-6b26-43d8-a2f3-e0f2a7faeeda tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094091 Jun 17 13:16:41.185266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1131/2357] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:41.298630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cec6fa6e-610f-4608-8c6c-7d8157271752 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:41.300015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cec6fa6e-610f-4608-8c6c-7d8157271752 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:41.306844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cec6fa6e-610f-4608-8c6c-7d8157271752 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.307282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cec6fa6e-610f-4608-8c6c-7d8157271752 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.308062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cec6fa6e-610f-4608-8c6c-7d8157271752 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.308490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cec6fa6e-610f-4608-8c6c-7d8157271752 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.338780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cec6fa6e-610f-4608-8c6c-7d8157271752 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047005 Jun 17 13:16:41.339326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1227/2358] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:42.077118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1c670f4-3c73-4302-bf02-20e4d50adb9c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:42.078160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1c670f4-3c73-4302-bf02-20e4d50adb9c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:42.085398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c670f4-3c73-4302-bf02-20e4d50adb9c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.085838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c670f4-3c73-4302-bf02-20e4d50adb9c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.086584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c670f4-3c73-4302-bf02-20e4d50adb9c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.087010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1c670f4-3c73-4302-bf02-20e4d50adb9c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.119883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1c670f4-3c73-4302-bf02-20e4d50adb9c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047011 Jun 17 13:16:42.120824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1132/2359] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:42 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:42.206890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:42.208027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:42.214967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.215455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.216208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.216668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.282856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:42.287310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:42.292139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bb36f4f2-0180-4b2c-988d-a3123921357a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092404 Jun 17 13:16:42.292715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1228/2360] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:42.350594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d2d6ff99-4635-4247-8293-8c6a4564e7f7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:42.351585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d2d6ff99-4635-4247-8293-8c6a4564e7f7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:42.358306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2d6ff99-4635-4247-8293-8c6a4564e7f7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.358781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2d6ff99-4635-4247-8293-8c6a4564e7f7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.359632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2d6ff99-4635-4247-8293-8c6a4564e7f7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.360091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2d6ff99-4635-4247-8293-8c6a4564e7f7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.391087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d2d6ff99-4635-4247-8293-8c6a4564e7f7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Jun 17 13:16:42.391678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1133/2361] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:43.133769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ed474a97-4548-425d-aaab-aa8b3643636a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:43.134797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ed474a97-4548-425d-aaab-aa8b3643636a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:43.141965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed474a97-4548-425d-aaab-aa8b3643636a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.142435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed474a97-4548-425d-aaab-aa8b3643636a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.143254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed474a97-4548-425d-aaab-aa8b3643636a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.143720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed474a97-4548-425d-aaab-aa8b3643636a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.173305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ed474a97-4548-425d-aaab-aa8b3643636a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Jun 17 13:16:43.173884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1229/2362] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:43 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:43.315199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:43.316279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:43.328136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.328878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.330185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.330901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.399224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:43.402870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5d2312ef-8965-46d5-8cc3-950cc6697257 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:43.403827 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5d2312ef-8965-46d5-8cc3-950cc6697257 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:43.408130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d0330f75-26c8-43f0-9e8e-913891fcf6b0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099294 Jun 17 13:16:43.408725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1134/2363] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:43.411284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d2312ef-8965-46d5-8cc3-950cc6697257 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.411764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d2312ef-8965-46d5-8cc3-950cc6697257 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.412539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d2312ef-8965-46d5-8cc3-950cc6697257 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.412987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d2312ef-8965-46d5-8cc3-950cc6697257 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.448329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5d2312ef-8965-46d5-8cc3-950cc6697257 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049338 Jun 17 13:16:43.448904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1230/2364] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:43 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:44.185859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa287f66-6174-42eb-8c9e-3b50c50e0b87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:44.186683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa287f66-6174-42eb-8c9e-3b50c50e0b87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:44.194884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa287f66-6174-42eb-8c9e-3b50c50e0b87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.195352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa287f66-6174-42eb-8c9e-3b50c50e0b87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.196247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa287f66-6174-42eb-8c9e-3b50c50e0b87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.196751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa287f66-6174-42eb-8c9e-3b50c50e0b87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.232168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa287f66-6174-42eb-8c9e-3b50c50e0b87 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050756 Jun 17 13:16:44.232692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1135/2365] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:44 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:44.428969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:44.429861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:44.436862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.437243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.437997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.438426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.459971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d6d5e9f7-c691-4584-9a55-a55edd79375f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:44.461158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d6d5e9f7-c691-4584-9a55-a55edd79375f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:44.470504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9f7-c691-4584-9a55-a55edd79375f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.471190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9f7-c691-4584-9a55-a55edd79375f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.472334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9f7-c691-4584-9a55-a55edd79375f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.472990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9f7-c691-4584-9a55-a55edd79375f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.479920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:44.504704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:44.511637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d6d5e9f7-c691-4584-9a55-a55edd79375f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055501 Jun 17 13:16:44.512454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1136/2366] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:44.513456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-70a01544-c2ef-44ab-99dc-284f9dafd93a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090355 Jun 17 13:16:44.514025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1231/2367] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:45.244768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-96698821-1d7d-4e81-aae0-33225bd492b2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:45.245701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-96698821-1d7d-4e81-aae0-33225bd492b2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:45.252630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96698821-1d7d-4e81-aae0-33225bd492b2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.253071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96698821-1d7d-4e81-aae0-33225bd492b2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.253819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96698821-1d7d-4e81-aae0-33225bd492b2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.254243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96698821-1d7d-4e81-aae0-33225bd492b2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.284296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-96698821-1d7d-4e81-aae0-33225bd492b2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Jun 17 13:16:45.284843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1137/2368] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:45 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:45.526075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e3baf873-9c80-4c7c-9097-deab91bbea12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:45.527009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e3baf873-9c80-4c7c-9097-deab91bbea12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:45.531972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:45.532630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:45.534053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3baf873-9c80-4c7c-9097-deab91bbea12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.534521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3baf873-9c80-4c7c-9097-deab91bbea12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.535272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3baf873-9c80-4c7c-9097-deab91bbea12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.535743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3baf873-9c80-4c7c-9097-deab91bbea12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.539482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.540032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.540795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.541222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.565257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e3baf873-9c80-4c7c-9097-deab91bbea12 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Jun 17 13:16:45.565818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1232/2369] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:45.602658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:45.610280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1aa3c17b-5902-4362-9ce7-7d83eb39f17c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.082125 Jun 17 13:16:45.610849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1138/2370] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:46.299551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c7e1611e-a75a-4124-b2d7-8229f0580d3b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:46.300993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c7e1611e-a75a-4124-b2d7-8229f0580d3b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:46.309956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e1611e-a75a-4124-b2d7-8229f0580d3b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.310405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e1611e-a75a-4124-b2d7-8229f0580d3b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.311165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e1611e-a75a-4124-b2d7-8229f0580d3b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.311646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7e1611e-a75a-4124-b2d7-8229f0580d3b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.342759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c7e1611e-a75a-4124-b2d7-8229f0580d3b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048961 Jun 17 13:16:46.343337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1233/2371] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:46 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:46.578127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eff47870-dfe6-4d22-ae08-5d53b5a12c7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:46.578968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eff47870-dfe6-4d22-ae08-5d53b5a12c7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:46.586190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff47870-dfe6-4d22-ae08-5d53b5a12c7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.586637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff47870-dfe6-4d22-ae08-5d53b5a12c7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.587414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff47870-dfe6-4d22-ae08-5d53b5a12c7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.587867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eff47870-dfe6-4d22-ae08-5d53b5a12c7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.618779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eff47870-dfe6-4d22-ae08-5d53b5a12c7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045454 Jun 17 13:16:46.619531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1139/2372] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:46.629588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:46.630544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:46.639998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.640512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.641258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.641689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.715322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:46.726770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7dec4a21-ef60-42b7-8ac7-330868a91fac tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.102522 Jun 17 13:16:46.727492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1234/2373] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:47.301617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:16:47.302004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:16:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:16:47.356637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6d63af42-ccd5-49fd-a5ef-1b5f8754822d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:47.357671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6d63af42-ccd5-49fd-a5ef-1b5f8754822d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:47.364456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d63af42-ccd5-49fd-a5ef-1b5f8754822d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.364897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d63af42-ccd5-49fd-a5ef-1b5f8754822d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.365654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d63af42-ccd5-49fd-a5ef-1b5f8754822d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.366112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d63af42-ccd5-49fd-a5ef-1b5f8754822d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.398929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6d63af42-ccd5-49fd-a5ef-1b5f8754822d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Jun 17 13:16:47.399403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1140/2374] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:47 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:47.635484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-714a38de-0a7e-452e-bb8e-55095b55955b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:47.637013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-714a38de-0a7e-452e-bb8e-55095b55955b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:47.648160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-714a38de-0a7e-452e-bb8e-55095b55955b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.648868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-714a38de-0a7e-452e-bb8e-55095b55955b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.650272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-714a38de-0a7e-452e-bb8e-55095b55955b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.650894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-714a38de-0a7e-452e-bb8e-55095b55955b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.682446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-714a38de-0a7e-452e-bb8e-55095b55955b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053678 Jun 17 13:16:47.683004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1235/2375] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:47.745794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:47.746404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:47.753201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.753639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.754404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.754838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.818184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:47.826175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-21f4c3b5-b3b5-487a-9f39-e10ee10ea012 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084326 Jun 17 13:16:47.827511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1141/2376] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:48.410951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-131b4389-2d22-4c0d-ba15-1a9f8251e371 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:48.411931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-131b4389-2d22-4c0d-ba15-1a9f8251e371 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:48.418783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131b4389-2d22-4c0d-ba15-1a9f8251e371 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.419232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131b4389-2d22-4c0d-ba15-1a9f8251e371 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.420018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131b4389-2d22-4c0d-ba15-1a9f8251e371 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.420450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131b4389-2d22-4c0d-ba15-1a9f8251e371 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.451560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-131b4389-2d22-4c0d-ba15-1a9f8251e371 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Jun 17 13:16:48.452172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1236/2377] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:48 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:48.698899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-76c1339b-fa89-4b6d-a210-3714885cf64e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:48.700309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-76c1339b-fa89-4b6d-a210-3714885cf64e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:48.710913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76c1339b-fa89-4b6d-a210-3714885cf64e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.711719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76c1339b-fa89-4b6d-a210-3714885cf64e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.712979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76c1339b-fa89-4b6d-a210-3714885cf64e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.713754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-76c1339b-fa89-4b6d-a210-3714885cf64e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.745092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-76c1339b-fa89-4b6d-a210-3714885cf64e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053035 Jun 17 13:16:48.745646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1142/2378] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:48.846524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:48.847522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:48.858500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.859361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.860557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.861092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.948267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:48.957048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dc9a5c4f-a60d-4c23-a17a-a30ef8441902 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.117373 Jun 17 13:16:48.957554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1237/2379] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:49.464187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-00d40db1-d15c-4586-af98-463772e2cab3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:49.465096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-00d40db1-d15c-4586-af98-463772e2cab3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:49.472386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00d40db1-d15c-4586-af98-463772e2cab3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.472831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00d40db1-d15c-4586-af98-463772e2cab3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.473585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00d40db1-d15c-4586-af98-463772e2cab3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.473995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00d40db1-d15c-4586-af98-463772e2cab3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.504437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-00d40db1-d15c-4586-af98-463772e2cab3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Jun 17 13:16:49.504992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1143/2380] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:49 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:49.761191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08718a3d-2812-4458-9f9b-48fc0a112cb5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:49.762669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08718a3d-2812-4458-9f9b-48fc0a112cb5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:49.770645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08718a3d-2812-4458-9f9b-48fc0a112cb5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.771116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08718a3d-2812-4458-9f9b-48fc0a112cb5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.771950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08718a3d-2812-4458-9f9b-48fc0a112cb5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.772384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08718a3d-2812-4458-9f9b-48fc0a112cb5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.802657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08718a3d-2812-4458-9f9b-48fc0a112cb5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048075 Jun 17 13:16:49.803205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1238/2381] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:49.977163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:49.978012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:49.987279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.987841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.988938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.989498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.057318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:50.065552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4c634e25-5162-46cd-a38a-c38bb1be8afc tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094617 Jun 17 13:16:50.066109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1144/2382] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:50.519597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef58b6af-c597-41a6-8343-dcc738d244c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:50.520529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef58b6af-c597-41a6-8343-dcc738d244c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:50.527580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef58b6af-c597-41a6-8343-dcc738d244c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.528030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef58b6af-c597-41a6-8343-dcc738d244c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.528792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef58b6af-c597-41a6-8343-dcc738d244c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.529236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef58b6af-c597-41a6-8343-dcc738d244c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.559747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef58b6af-c597-41a6-8343-dcc738d244c6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Jun 17 13:16:50.560303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1239/2383] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:50.815431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4f8916fe-57d9-44f3-9663-9092b75ef693 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:50.816411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4f8916fe-57d9-44f3-9663-9092b75ef693 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:50.824558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f8916fe-57d9-44f3-9663-9092b75ef693 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.825090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f8916fe-57d9-44f3-9663-9092b75ef693 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.825949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f8916fe-57d9-44f3-9663-9092b75ef693 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.826581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f8916fe-57d9-44f3-9663-9092b75ef693 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.858513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4f8916fe-57d9-44f3-9663-9092b75ef693 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047953 Jun 17 13:16:50.859067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1145/2384] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:50 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:51.087211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:51.088141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:51.098999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.099806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.101034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.101740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.172249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:51.180659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2cad78c0-5306-4107-bce9-6f02ad3f1b80 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100382 Jun 17 13:16:51.181232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1240/2385] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:51.571828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6350ee27-f080-48a9-ae68-091b14074a5b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:51.572749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6350ee27-f080-48a9-ae68-091b14074a5b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:51.579617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6350ee27-f080-48a9-ae68-091b14074a5b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.580591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6350ee27-f080-48a9-ae68-091b14074a5b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.581376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6350ee27-f080-48a9-ae68-091b14074a5b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.581806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6350ee27-f080-48a9-ae68-091b14074a5b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.613090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6350ee27-f080-48a9-ae68-091b14074a5b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Jun 17 13:16:51.613656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1146/2386] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:51 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:51.870569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-815e705e-f583-453e-a0cb-472f5b326a26 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:51.871548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-815e705e-f583-453e-a0cb-472f5b326a26 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:51.879019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-815e705e-f583-453e-a0cb-472f5b326a26 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.879498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-815e705e-f583-453e-a0cb-472f5b326a26 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.880248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-815e705e-f583-453e-a0cb-472f5b326a26 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.880682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-815e705e-f583-453e-a0cb-472f5b326a26 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.913749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-815e705e-f583-453e-a0cb-472f5b326a26 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Jun 17 13:16:51.914329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1241/2387] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:52.208505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:52.209638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:52.220380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.221345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.222016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.222444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.294384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:52.302816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1973684-1c2d-4075-823e-65964efefa4e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.101711 Jun 17 13:16:52.303394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1147/2388] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:52.629939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-87140da6-5fc0-4de6-9e8a-aa865837ffe0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:52.631446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-87140da6-5fc0-4de6-9e8a-aa865837ffe0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:52.641608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87140da6-5fc0-4de6-9e8a-aa865837ffe0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.642327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87140da6-5fc0-4de6-9e8a-aa865837ffe0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.643667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87140da6-5fc0-4de6-9e8a-aa865837ffe0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.644105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87140da6-5fc0-4de6-9e8a-aa865837ffe0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.673899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-87140da6-5fc0-4de6-9e8a-aa865837ffe0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051139 Jun 17 13:16:52.674446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1242/2389] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:52.930339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c11a67df-e4ad-44c0-82ed-e0fd98cc4229 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:52.931876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c11a67df-e4ad-44c0-82ed-e0fd98cc4229 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:52.942122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c11a67df-e4ad-44c0-82ed-e0fd98cc4229 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.942598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c11a67df-e4ad-44c0-82ed-e0fd98cc4229 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.943356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c11a67df-e4ad-44c0-82ed-e0fd98cc4229 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.943812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c11a67df-e4ad-44c0-82ed-e0fd98cc4229 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.973282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c11a67df-e4ad-44c0-82ed-e0fd98cc4229 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050103 Jun 17 13:16:52.973859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1148/2390] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:53.324983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:53.325918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:53.335659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.336105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.336869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.337302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.409966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:53.417783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-88214c8c-c7d2-425a-8ba6-68caa1a77eaf tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099495 Jun 17 13:16:53.418348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1243/2391] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:53.689948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7f73ece1-7f51-425a-b260-24e9f61022ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:53.691523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7f73ece1-7f51-425a-b260-24e9f61022ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:53.698906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f73ece1-7f51-425a-b260-24e9f61022ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.699354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f73ece1-7f51-425a-b260-24e9f61022ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.700172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f73ece1-7f51-425a-b260-24e9f61022ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.700609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f73ece1-7f51-425a-b260-24e9f61022ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.731016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7f73ece1-7f51-425a-b260-24e9f61022ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048189 Jun 17 13:16:53.731573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1149/2392] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:53.990833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1197d46e-f9a4-41f9-ae69-3a60f0078f01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:53.991716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1197d46e-f9a4-41f9-ae69-3a60f0078f01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:53.998329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1197d46e-f9a4-41f9-ae69-3a60f0078f01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.998782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1197d46e-f9a4-41f9-ae69-3a60f0078f01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.999940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1197d46e-f9a4-41f9-ae69-3a60f0078f01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.000377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1197d46e-f9a4-41f9-ae69-3a60f0078f01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.030659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1197d46e-f9a4-41f9-ae69-3a60f0078f01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Jun 17 13:16:54.031218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1244/2393] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:54.438565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:54.439628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:54.446975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.447426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.448215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.448654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.517434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:54.525402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7c0122b4-8c4e-47c4-8134-62044646c0dd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093592 Jun 17 13:16:54.525962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1150/2394] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:54.744504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-26a96dae-a3ca-47ec-9cea-d81f22779f0e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:54.745436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-26a96dae-a3ca-47ec-9cea-d81f22779f0e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:54.752385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26a96dae-a3ca-47ec-9cea-d81f22779f0e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.752835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26a96dae-a3ca-47ec-9cea-d81f22779f0e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.753595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26a96dae-a3ca-47ec-9cea-d81f22779f0e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.754026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26a96dae-a3ca-47ec-9cea-d81f22779f0e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.770599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:54.784680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-26a96dae-a3ca-47ec-9cea-d81f22779f0e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Jun 17 13:16:54.785233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1245/2395] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:55.023671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:16:55.024006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:16:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:16:55.042835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5baa9eed-635a-42c1-ab5b-2bf453cf0788 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:55.043803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5baa9eed-635a-42c1-ab5b-2bf453cf0788 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:55.050968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5baa9eed-635a-42c1-ab5b-2bf453cf0788 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.051408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5baa9eed-635a-42c1-ab5b-2bf453cf0788 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.052283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5baa9eed-635a-42c1-ab5b-2bf453cf0788 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.052725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5baa9eed-635a-42c1-ab5b-2bf453cf0788 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.083570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5baa9eed-635a-42c1-ab5b-2bf453cf0788 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Jun 17 13:16:55.084133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1151/2396] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:55.542644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:55.543258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:55.550323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.550774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.551577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.552053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.614952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:55.622927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e200698b-0b58-4451-a4cc-eb6a8b8b1c1d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084283 Jun 17 13:16:55.623505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1246/2397] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:55.800672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a4f253e-817b-4132-9a50-eb4ce10a98a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:55.802239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a4f253e-817b-4132-9a50-eb4ce10a98a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:55.813188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a4f253e-817b-4132-9a50-eb4ce10a98a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.813941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a4f253e-817b-4132-9a50-eb4ce10a98a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.815226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a4f253e-817b-4132-9a50-eb4ce10a98a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.815995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a4f253e-817b-4132-9a50-eb4ce10a98a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.842273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:55.846909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a4f253e-817b-4132-9a50-eb4ce10a98a9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053237 Jun 17 13:16:55.847478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1152/2398] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:55 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:56.099283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-809175c5-aa30-4efb-93fa-c4848848448e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:56.100669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-809175c5-aa30-4efb-93fa-c4848848448e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:56.109765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-809175c5-aa30-4efb-93fa-c4848848448e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.110209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-809175c5-aa30-4efb-93fa-c4848848448e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.110962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-809175c5-aa30-4efb-93fa-c4848848448e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.111839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-809175c5-aa30-4efb-93fa-c4848848448e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.143015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-809175c5-aa30-4efb-93fa-c4848848448e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050339 Jun 17 13:16:56.143611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1247/2399] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:56 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:56.641657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:56.643572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:56.651474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.652207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.653445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.654066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.717270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:56.725108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-018768bf-1fcd-487a-a17d-19f2977a2da2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088813 Jun 17 13:16:56.725683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1153/2400] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:56.861189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-96ee3b38-86ca-4893-b613-59754b1f08a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:56.862781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-96ee3b38-86ca-4893-b613-59754b1f08a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:56.870344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96ee3b38-86ca-4893-b613-59754b1f08a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.870730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96ee3b38-86ca-4893-b613-59754b1f08a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.871520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96ee3b38-86ca-4893-b613-59754b1f08a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.871956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-96ee3b38-86ca-4893-b613-59754b1f08a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.902545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-96ee3b38-86ca-4893-b613-59754b1f08a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Jun 17 13:16:56.903157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1248/2401] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:57.159318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-52473e96-3a2c-4520-9327-96a3fa5d74ba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:57.160522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-52473e96-3a2c-4520-9327-96a3fa5d74ba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:57.170481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52473e96-3a2c-4520-9327-96a3fa5d74ba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.171067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52473e96-3a2c-4520-9327-96a3fa5d74ba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.172115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52473e96-3a2c-4520-9327-96a3fa5d74ba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.172662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-52473e96-3a2c-4520-9327-96a3fa5d74ba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.203761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-52473e96-3a2c-4520-9327-96a3fa5d74ba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051472 Jun 17 13:16:57.204286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1154/2402] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:57 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:57.743752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:57.744360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:57.752187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.752680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.753551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.754039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.822800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:57.834250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe2cc9d7-6c86-4d55-a347-bf81390f0559 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095055 Jun 17 13:16:57.834784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1249/2403] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:57.917844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e38e69eb-11f4-4186-91b7-254d306b4e78 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:57.919255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e38e69eb-11f4-4186-91b7-254d306b4e78 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:57.929115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e38e69eb-11f4-4186-91b7-254d306b4e78 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.929559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e38e69eb-11f4-4186-91b7-254d306b4e78 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.930344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e38e69eb-11f4-4186-91b7-254d306b4e78 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.930774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e38e69eb-11f4-4186-91b7-254d306b4e78 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.960642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e38e69eb-11f4-4186-91b7-254d306b4e78 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Jun 17 13:16:57.961189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1155/2404] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:58.221063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f4c23737-35d5-46b5-80a6-04ea669fb038 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:58.222561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f4c23737-35d5-46b5-80a6-04ea669fb038 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:58.230887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4c23737-35d5-46b5-80a6-04ea669fb038 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.231338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4c23737-35d5-46b5-80a6-04ea669fb038 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.232126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4c23737-35d5-46b5-80a6-04ea669fb038 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.232564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4c23737-35d5-46b5-80a6-04ea669fb038 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.261947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f4c23737-35d5-46b5-80a6-04ea669fb038 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047622 Jun 17 13:16:58.262493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1250/2405] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:58 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:58.851126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:58.851781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:58.858398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.858846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.859636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.860080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.927330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:16:58.935712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-55faa196-2173-4fb9-8ba6-cee6f5391e6a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088911 Jun 17 13:16:58.936306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1156/2406] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:16:58.972608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4ddd1706-4030-4ac1-9ccd-437fc0b836cf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:58.973546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4ddd1706-4030-4ac1-9ccd-437fc0b836cf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:58.980633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddd1706-4030-4ac1-9ccd-437fc0b836cf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.981071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddd1706-4030-4ac1-9ccd-437fc0b836cf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.981846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddd1706-4030-4ac1-9ccd-437fc0b836cf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.982244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddd1706-4030-4ac1-9ccd-437fc0b836cf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.014538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4ddd1706-4030-4ac1-9ccd-437fc0b836cf tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Jun 17 13:16:59.015062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1251/2407] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:59.278785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-997d885e-d0be-4327-a61e-c40ec185f9d8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:59.280598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-997d885e-d0be-4327-a61e-c40ec185f9d8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:59.292116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-997d885e-d0be-4327-a61e-c40ec185f9d8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.292842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-997d885e-d0be-4327-a61e-c40ec185f9d8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.294095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-997d885e-d0be-4327-a61e-c40ec185f9d8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.294798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-997d885e-d0be-4327-a61e-c40ec185f9d8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.332318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-997d885e-d0be-4327-a61e-c40ec185f9d8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060761 Jun 17 13:16:59.332862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1157/2408] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:59 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:59.953659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:59.954255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:59.961771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.962213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.962955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.963376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:00.027321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bbae5736-e481-4ddc-9e1a-a614e2398266 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:00.027860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:00.028431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bbae5736-e481-4ddc-9e1a-a614e2398266 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:00.034885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbae5736-e481-4ddc-9e1a-a614e2398266 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:00.035331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbae5736-e481-4ddc-9e1a-a614e2398266 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:00.035524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-73af1b95-94fd-4475-9423-cd24f61914ee tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085794 Jun 17 13:17:00.036087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1252/2409] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:16:59 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:00.036267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbae5736-e481-4ddc-9e1a-a614e2398266 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:00.036639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bbae5736-e481-4ddc-9e1a-a614e2398266 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:00.067089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bbae5736-e481-4ddc-9e1a-a614e2398266 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Jun 17 13:17:00.067688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1158/2410] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:00.346614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8394eb43-8605-4c68-8bd9-759302b3e11b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:00.347571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8394eb43-8605-4c68-8bd9-759302b3e11b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:00.354315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8394eb43-8605-4c68-8bd9-759302b3e11b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:00.354759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8394eb43-8605-4c68-8bd9-759302b3e11b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:00.355568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8394eb43-8605-4c68-8bd9-759302b3e11b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:00.355999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8394eb43-8605-4c68-8bd9-759302b3e11b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:00.386023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8394eb43-8605-4c68-8bd9-759302b3e11b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 Jun 17 13:17:00.386548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1253/2411] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:01.058290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:01.059532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:01.070641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.071288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.071970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.072605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.080342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3e351774-1547-4fc0-ac34-35e889231fc1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:01.081270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3e351774-1547-4fc0-ac34-35e889231fc1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:01.089226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e351774-1547-4fc0-ac34-35e889231fc1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.089226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e351774-1547-4fc0-ac34-35e889231fc1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.090031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e351774-1547-4fc0-ac34-35e889231fc1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.090464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e351774-1547-4fc0-ac34-35e889231fc1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.121735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3e351774-1547-4fc0-ac34-35e889231fc1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046089 Jun 17 13:17:01.122325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1254/2412] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:01.137229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:01.145430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3ce87d7f-10a2-4e00-8c3a-5f9bb145225b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094638 Jun 17 13:17:01.145997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1159/2413] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:01.400259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8c752d61-c4e7-4554-afb5-a9ddb30ee34a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:01.401086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8c752d61-c4e7-4554-afb5-a9ddb30ee34a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:01.407616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c752d61-c4e7-4554-afb5-a9ddb30ee34a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.408061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c752d61-c4e7-4554-afb5-a9ddb30ee34a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.408814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c752d61-c4e7-4554-afb5-a9ddb30ee34a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.409246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8c752d61-c4e7-4554-afb5-a9ddb30ee34a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.439102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8c752d61-c4e7-4554-afb5-a9ddb30ee34a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Jun 17 13:17:01.439743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1255/2414] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:02.135485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2ff97b6c-6a09-4b93-b668-b3b34f333ac7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:02.136580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2ff97b6c-6a09-4b93-b668-b3b34f333ac7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:02.144812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ff97b6c-6a09-4b93-b668-b3b34f333ac7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.145348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ff97b6c-6a09-4b93-b668-b3b34f333ac7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.146235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ff97b6c-6a09-4b93-b668-b3b34f333ac7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.146743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ff97b6c-6a09-4b93-b668-b3b34f333ac7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.163417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:02.164075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:02.171280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.171763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.172518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.172946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.179298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2ff97b6c-6a09-4b93-b668-b3b34f333ac7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048762 Jun 17 13:17:02.179946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1160/2415] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:02 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:02.236421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:02.244442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8fd73637-f668-4bb7-9cd3-a61b60a5285d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085108 Jun 17 13:17:02.244982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1256/2416] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:02.451323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-26295f1b-deef-46d6-b353-ceece8d2f32e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:02.452188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-26295f1b-deef-46d6-b353-ceece8d2f32e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:02.461185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26295f1b-deef-46d6-b353-ceece8d2f32e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.461907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26295f1b-deef-46d6-b353-ceece8d2f32e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.463170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26295f1b-deef-46d6-b353-ceece8d2f32e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.463866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26295f1b-deef-46d6-b353-ceece8d2f32e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.500139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-26295f1b-deef-46d6-b353-ceece8d2f32e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053398 Jun 17 13:17:02.500699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1161/2417] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:03.193409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0a26b5e-c2ee-4704-b395-3f517f0bd9e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:03.194751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0a26b5e-c2ee-4704-b395-3f517f0bd9e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:03.197110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=86 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:03.202569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a26b5e-c2ee-4704-b395-3f517f0bd9e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.203013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a26b5e-c2ee-4704-b395-3f517f0bd9e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.203860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a26b5e-c2ee-4704-b395-3f517f0bd9e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.204292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0a26b5e-c2ee-4704-b395-3f517f0bd9e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.235703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0a26b5e-c2ee-4704-b395-3f517f0bd9e9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Jun 17 13:17:03.236252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1257/2418] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:03.262865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:03.263452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:03.270153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.270595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.271333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.271791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.341067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:03.352587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d61abb35-a002-4c42-bef2-570796a49735 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093526 Jun 17 13:17:03.353163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1162/2419] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:03.514150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-821a69cd-9d77-4d64-91e7-0d84f2738e7a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:03.515524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-821a69cd-9d77-4d64-91e7-0d84f2738e7a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:03.524773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-821a69cd-9d77-4d64-91e7-0d84f2738e7a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.525402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-821a69cd-9d77-4d64-91e7-0d84f2738e7a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.526428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-821a69cd-9d77-4d64-91e7-0d84f2738e7a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.527029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-821a69cd-9d77-4d64-91e7-0d84f2738e7a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.560539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-821a69cd-9d77-4d64-91e7-0d84f2738e7a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051849 Jun 17 13:17:03.561091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1258/2420] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:04.247010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-63728c61-f868-4f0b-bcd1-c96b83f3e744 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:04.247976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-63728c61-f868-4f0b-bcd1-c96b83f3e744 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:04.255191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63728c61-f868-4f0b-bcd1-c96b83f3e744 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.255741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63728c61-f868-4f0b-bcd1-c96b83f3e744 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.256501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63728c61-f868-4f0b-bcd1-c96b83f3e744 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.256935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63728c61-f868-4f0b-bcd1-c96b83f3e744 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.287402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-63728c61-f868-4f0b-bcd1-c96b83f3e744 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Jun 17 13:17:04.288033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1163/2421] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:04.379114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:04.380151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:04.391355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.392138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.393382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.394093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.469378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:04.477615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-08896f44-6f98-4267-b5ae-23d6f14a1194 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.105435 Jun 17 13:17:04.478177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1259/2422] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:04.576040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-be906b99-ea92-443e-89f6-cbdba6d4a07c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:04.577207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-be906b99-ea92-443e-89f6-cbdba6d4a07c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:04.586756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be906b99-ea92-443e-89f6-cbdba6d4a07c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.587230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be906b99-ea92-443e-89f6-cbdba6d4a07c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.588026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be906b99-ea92-443e-89f6-cbdba6d4a07c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.588447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be906b99-ea92-443e-89f6-cbdba6d4a07c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.622294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-be906b99-ea92-443e-89f6-cbdba6d4a07c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052550 Jun 17 13:17:04.623090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1164/2423] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:05.304561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8bf9cb96-3591-4fb4-aae1-70feff4ef82c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:05.306075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8bf9cb96-3591-4fb4-aae1-70feff4ef82c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:05.316498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf9cb96-3591-4fb4-aae1-70feff4ef82c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.317247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf9cb96-3591-4fb4-aae1-70feff4ef82c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.318500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf9cb96-3591-4fb4-aae1-70feff4ef82c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.319218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8bf9cb96-3591-4fb4-aae1-70feff4ef82c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.350405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8bf9cb96-3591-4fb4-aae1-70feff4ef82c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052568 Jun 17 13:17:05.351027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1260/2424] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:05 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:05.496544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:05.497144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:05.504623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.505068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.505823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.506254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.575963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:05.583958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5c3b7f64-24e0-4a48-8d68-5e6df065122b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092521 Jun 17 13:17:05.584660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1165/2425] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:05.636973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30023ede-c3fb-4f5d-9274-37260c98eb64 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:05.637902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30023ede-c3fb-4f5d-9274-37260c98eb64 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:05.645095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30023ede-c3fb-4f5d-9274-37260c98eb64 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.645548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30023ede-c3fb-4f5d-9274-37260c98eb64 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.646299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30023ede-c3fb-4f5d-9274-37260c98eb64 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.646732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30023ede-c3fb-4f5d-9274-37260c98eb64 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.676542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30023ede-c3fb-4f5d-9274-37260c98eb64 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Jun 17 13:17:05.677099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1261/2426] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:06.364118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dd7d3975-2652-4beb-85e9-55517502995d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:06.365267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dd7d3975-2652-4beb-85e9-55517502995d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:06.372674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd7d3975-2652-4beb-85e9-55517502995d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.373129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd7d3975-2652-4beb-85e9-55517502995d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.373886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd7d3975-2652-4beb-85e9-55517502995d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.374679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd7d3975-2652-4beb-85e9-55517502995d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.409077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dd7d3975-2652-4beb-85e9-55517502995d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049904 Jun 17 13:17:06.409731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1166/2427] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:06 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:06.602822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:06.603633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:06.610946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.611359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.612138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.612564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.616579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:06.682475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:06.688453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e5e68eb3-515c-4b87-867a-bf7115b5c784 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:06.689377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e5e68eb3-515c-4b87-867a-bf7115b5c784 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:06.690571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3fd1fa2f-4663-4bef-8784-cebecf58a9b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092853 Jun 17 13:17:06.691131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1262/2428] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:06.695959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5e68eb3-515c-4b87-867a-bf7115b5c784 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.696401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5e68eb3-515c-4b87-867a-bf7115b5c784 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.697157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5e68eb3-515c-4b87-867a-bf7115b5c784 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.697582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5e68eb3-515c-4b87-867a-bf7115b5c784 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.728621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e5e68eb3-515c-4b87-867a-bf7115b5c784 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Jun 17 13:17:06.729170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1167/2429] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:07.421855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-20d1bef1-0c70-4e9c-9a25-5546e94d4283 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:07.422674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-20d1bef1-0c70-4e9c-9a25-5546e94d4283 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:07.429459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20d1bef1-0c70-4e9c-9a25-5546e94d4283 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.429928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20d1bef1-0c70-4e9c-9a25-5546e94d4283 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.430686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20d1bef1-0c70-4e9c-9a25-5546e94d4283 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.431241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20d1bef1-0c70-4e9c-9a25-5546e94d4283 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.469296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-20d1bef1-0c70-4e9c-9a25-5546e94d4283 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051551 Jun 17 13:17:07.469904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1263/2430] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:07 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:07.711353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:07.712428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:07.719202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.719644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.720396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.720819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.743275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b71a2cf1-1157-4abb-8924-6ad8de2b061b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:07.744493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b71a2cf1-1157-4abb-8924-6ad8de2b061b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:07.751795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b71a2cf1-1157-4abb-8924-6ad8de2b061b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.752375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b71a2cf1-1157-4abb-8924-6ad8de2b061b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.753137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b71a2cf1-1157-4abb-8924-6ad8de2b061b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.753564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b71a2cf1-1157-4abb-8924-6ad8de2b061b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.785236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b71a2cf1-1157-4abb-8924-6ad8de2b061b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048481 Jun 17 13:17:07.786712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1264/2431] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:07 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:07.789254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:07.798168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7929a9f0-6944-4cdc-8cb8-d4315efb3eb7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093245 Jun 17 13:17:07.798736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1168/2432] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:17:08.480766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a4674f59-180a-442e-a350-82a1868991ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:08.481650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a4674f59-180a-442e-a350-82a1868991ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:08.488157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4674f59-180a-442e-a350-82a1868991ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.488588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4674f59-180a-442e-a350-82a1868991ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.489341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4674f59-180a-442e-a350-82a1868991ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.489773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a4674f59-180a-442e-a350-82a1868991ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.519671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a4674f59-180a-442e-a350-82a1868991ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043138 Jun 17 13:17:08.520220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1265/2433] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:08 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:08.798129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-125b0579-c4b3-4582-9aec-91c3db68b9d9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:08.799059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-125b0579-c4b3-4582-9aec-91c3db68b9d9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:08.806256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-125b0579-c4b3-4582-9aec-91c3db68b9d9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.806884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-125b0579-c4b3-4582-9aec-91c3db68b9d9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.808209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-125b0579-c4b3-4582-9aec-91c3db68b9d9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.809121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-125b0579-c4b3-4582-9aec-91c3db68b9d9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.816591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:08.817578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:08.826469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.826724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:08.826913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.827760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.828243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.846645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-125b0579-c4b3-4582-9aec-91c3db68b9d9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052513 Jun 17 13:17:08.847536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1169/2434] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:08.891859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:08.899520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1f64851a-0da7-4337-b371-40d46bb69a20 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087376 Jun 17 13:17:08.900716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1266/2435] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:09.533660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-17b0585a-3168-45a8-895c-2f8351831f89 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:09.535057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-17b0585a-3168-45a8-895c-2f8351831f89 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:09.543479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17b0585a-3168-45a8-895c-2f8351831f89 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.543924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17b0585a-3168-45a8-895c-2f8351831f89 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.544673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17b0585a-3168-45a8-895c-2f8351831f89 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.545105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-17b0585a-3168-45a8-895c-2f8351831f89 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.575039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-17b0585a-3168-45a8-895c-2f8351831f89 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Jun 17 13:17:09.575624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1170/2436] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:09 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:09.858746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0baefd28-a183-4d5c-bb06-9d0ccc906a96 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:09.859632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0baefd28-a183-4d5c-bb06-9d0ccc906a96 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:09.866401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0baefd28-a183-4d5c-bb06-9d0ccc906a96 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.866837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0baefd28-a183-4d5c-bb06-9d0ccc906a96 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.867632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0baefd28-a183-4d5c-bb06-9d0ccc906a96 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.868075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0baefd28-a183-4d5c-bb06-9d0ccc906a96 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.898233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0baefd28-a183-4d5c-bb06-9d0ccc906a96 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Jun 17 13:17:09.898767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1267/2437] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:09.917195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:09.917805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:09.924932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.925495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.926637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.927261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.990293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:09.998458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2e79efac-190c-41d1-b334-5fefffd36e84 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085198 Jun 17 13:17:09.999390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1171/2438] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:09 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:10.591419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aedfcd7b-5f57-4e33-a739-e71cba08d76a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:10.593198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aedfcd7b-5f57-4e33-a739-e71cba08d76a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:10.604554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedfcd7b-5f57-4e33-a739-e71cba08d76a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.605000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedfcd7b-5f57-4e33-a739-e71cba08d76a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.605770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedfcd7b-5f57-4e33-a739-e71cba08d76a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.606203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedfcd7b-5f57-4e33-a739-e71cba08d76a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.638675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aedfcd7b-5f57-4e33-a739-e71cba08d76a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053345 Jun 17 13:17:10.639201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1268/2439] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:10 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:10.911479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-acf521d8-a7b1-4ca6-b586-16bdbc66a7f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:10.912354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-acf521d8-a7b1-4ca6-b586-16bdbc66a7f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:10.914515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=86 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:10.920673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acf521d8-a7b1-4ca6-b586-16bdbc66a7f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.921309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acf521d8-a7b1-4ca6-b586-16bdbc66a7f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.921864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acf521d8-a7b1-4ca6-b586-16bdbc66a7f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.922292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acf521d8-a7b1-4ca6-b586-16bdbc66a7f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.958123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-acf521d8-a7b1-4ca6-b586-16bdbc66a7f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051104 Jun 17 13:17:10.960120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1172/2440] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:11.017253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:11.018044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:11.027284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.028001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.028896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.029349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.102389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:11.112877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-704b196b-72e2-4e96-a222-2cb1eb678412 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100492 Jun 17 13:17:11.113457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1269/2441] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:11.651197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-402ad55e-645a-4710-b2fa-a9086272b774 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:11.652197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-402ad55e-645a-4710-b2fa-a9086272b774 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:11.658816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-402ad55e-645a-4710-b2fa-a9086272b774 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.659304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-402ad55e-645a-4710-b2fa-a9086272b774 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.660122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-402ad55e-645a-4710-b2fa-a9086272b774 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.660593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-402ad55e-645a-4710-b2fa-a9086272b774 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.690549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-402ad55e-645a-4710-b2fa-a9086272b774 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 Jun 17 13:17:11.691114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1173/2442] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:11 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:11.970526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a1bb0e60-cf70-48b1-a4c3-3d5b6039e38b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:11.971473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a1bb0e60-cf70-48b1-a4c3-3d5b6039e38b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:11.978087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1bb0e60-cf70-48b1-a4c3-3d5b6039e38b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.978541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1bb0e60-cf70-48b1-a4c3-3d5b6039e38b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.979284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1bb0e60-cf70-48b1-a4c3-3d5b6039e38b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.979751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1bb0e60-cf70-48b1-a4c3-3d5b6039e38b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.010531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a1bb0e60-cf70-48b1-a4c3-3d5b6039e38b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Jun 17 13:17:12.011120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1270/2443] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:12.131023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:12.131663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:12.139353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.139826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.140569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.140989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.203565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:12.211826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9794f9ad-d6f8-479a-bf85-5d0672ed2002 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085030 Jun 17 13:17:12.213179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1174/2444] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:12.702892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-abdd7c1d-699f-418e-bf71-c79fe494159d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:12.703839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-abdd7c1d-699f-418e-bf71-c79fe494159d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:12.710866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abdd7c1d-699f-418e-bf71-c79fe494159d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.711303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abdd7c1d-699f-418e-bf71-c79fe494159d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.712074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abdd7c1d-699f-418e-bf71-c79fe494159d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.713057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-abdd7c1d-699f-418e-bf71-c79fe494159d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.743032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-abdd7c1d-699f-418e-bf71-c79fe494159d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Jun 17 13:17:12.745970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1271/2445] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:12 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:13.022895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0d12b75b-7de1-4bf3-b14b-e5c9fe593cda tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:13.023928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d12b75b-7de1-4bf3-b14b-e5c9fe593cda tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:13.030559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d12b75b-7de1-4bf3-b14b-e5c9fe593cda tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.031004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d12b75b-7de1-4bf3-b14b-e5c9fe593cda tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.031803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d12b75b-7de1-4bf3-b14b-e5c9fe593cda tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.032235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d12b75b-7de1-4bf3-b14b-e5c9fe593cda tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.068202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0d12b75b-7de1-4bf3-b14b-e5c9fe593cda tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049292 Jun 17 13:17:13.068781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1175/2446] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:13.230081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:13.230718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:13.237514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.237964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.238719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.239153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.309198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:13.317356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-67315464-052a-4afe-bf2f-84ecfeb78420 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091259 Jun 17 13:17:13.317922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1272/2447] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:13.761980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cb0826ab-beed-427a-a481-86302248ef09 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:13.763492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cb0826ab-beed-427a-a481-86302248ef09 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:13.774563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb0826ab-beed-427a-a481-86302248ef09 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.775301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb0826ab-beed-427a-a481-86302248ef09 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.776533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb0826ab-beed-427a-a481-86302248ef09 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.777046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb0826ab-beed-427a-a481-86302248ef09 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.808952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cb0826ab-beed-427a-a481-86302248ef09 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053647 Jun 17 13:17:13.809513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1176/2448] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:14.086825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2c30d76-0186-4b16-a774-6d7e47501b68 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:14.088251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2c30d76-0186-4b16-a774-6d7e47501b68 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:14.099547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2c30d76-0186-4b16-a774-6d7e47501b68 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.100296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2c30d76-0186-4b16-a774-6d7e47501b68 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.101529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2c30d76-0186-4b16-a774-6d7e47501b68 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.102264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2c30d76-0186-4b16-a774-6d7e47501b68 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.135106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2c30d76-0186-4b16-a774-6d7e47501b68 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055239 Jun 17 13:17:14.135768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1273/2449] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:14.338798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:14.339594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:14.346142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.346590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.347349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.347811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.425335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:14.433394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e376ee75-e412-4dee-9f37-9a389b9410d0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100984 Jun 17 13:17:14.433956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1177/2450] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:14.823189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9f6cf77c-1cbc-4ebd-9fce-52982afef33d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:14.824315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9f6cf77c-1cbc-4ebd-9fce-52982afef33d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:14.830893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f6cf77c-1cbc-4ebd-9fce-52982afef33d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.831343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f6cf77c-1cbc-4ebd-9fce-52982afef33d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.832121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f6cf77c-1cbc-4ebd-9fce-52982afef33d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.832552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f6cf77c-1cbc-4ebd-9fce-52982afef33d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.862574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9f6cf77c-1cbc-4ebd-9fce-52982afef33d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Jun 17 13:17:14.863128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1274/2451] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:14 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:15.146682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ed7a2cbd-f16b-4f3f-b22d-0777c508cd30 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:15.147660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ed7a2cbd-f16b-4f3f-b22d-0777c508cd30 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:15.154848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed7a2cbd-f16b-4f3f-b22d-0777c508cd30 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.155298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed7a2cbd-f16b-4f3f-b22d-0777c508cd30 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.156097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed7a2cbd-f16b-4f3f-b22d-0777c508cd30 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.156516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ed7a2cbd-f16b-4f3f-b22d-0777c508cd30 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.189652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ed7a2cbd-f16b-4f3f-b22d-0777c508cd30 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046941 Jun 17 13:17:15.190210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1178/2452] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:15.452341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:15.453053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:15.463528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.464269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.465469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.466067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.539882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:15.547729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b1fdd487-463c-4386-af88-7178ee884214 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100121 Jun 17 13:17:15.548262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1275/2453] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:15.875439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad4abed8-7c08-4455-97f2-db362a580e96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:15.876370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad4abed8-7c08-4455-97f2-db362a580e96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:15.882878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad4abed8-7c08-4455-97f2-db362a580e96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.883326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad4abed8-7c08-4455-97f2-db362a580e96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.884113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad4abed8-7c08-4455-97f2-db362a580e96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.884550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad4abed8-7c08-4455-97f2-db362a580e96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.916214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad4abed8-7c08-4455-97f2-db362a580e96 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Jun 17 13:17:15.917071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1179/2454] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:15 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:16.206368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8106ff2c-783b-45cc-8be1-ec26aa2cf15b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:16.207195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8106ff2c-783b-45cc-8be1-ec26aa2cf15b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:16.213459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8106ff2c-783b-45cc-8be1-ec26aa2cf15b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.213904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8106ff2c-783b-45cc-8be1-ec26aa2cf15b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.214658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8106ff2c-783b-45cc-8be1-ec26aa2cf15b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.215112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8106ff2c-783b-45cc-8be1-ec26aa2cf15b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.246634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8106ff2c-783b-45cc-8be1-ec26aa2cf15b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046086 Jun 17 13:17:16.247209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1276/2455] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:16.570084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:16.571067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:16.582468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.583321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.584496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.585194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.654838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:16.663144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b4a30843-5412-4db6-91d9-a7458c989cf7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098959 Jun 17 13:17:16.663748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1180/2456] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:16.931569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c46608e5-da09-441f-b9b4-9e2d6a05b739 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:16.932966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c46608e5-da09-441f-b9b4-9e2d6a05b739 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:16.945400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c46608e5-da09-441f-b9b4-9e2d6a05b739 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.946399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c46608e5-da09-441f-b9b4-9e2d6a05b739 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.948172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c46608e5-da09-441f-b9b4-9e2d6a05b739 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.949106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c46608e5-da09-441f-b9b4-9e2d6a05b739 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.984873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c46608e5-da09-441f-b9b4-9e2d6a05b739 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060098 Jun 17 13:17:16.985437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1277/2457] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:16 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:17.263182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1eff836e-8200-48c8-8ca0-4990e636601b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:17.264443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1eff836e-8200-48c8-8ca0-4990e636601b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:17.271290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eff836e-8200-48c8-8ca0-4990e636601b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.271760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eff836e-8200-48c8-8ca0-4990e636601b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:17.272521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eff836e-8200-48c8-8ca0-4990e636601b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.272951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eff836e-8200-48c8-8ca0-4990e636601b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:17.304128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1eff836e-8200-48c8-8ca0-4990e636601b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047875 Jun 17 13:17:17.304674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1181/2458] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:17.684144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:17.684970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:17.695429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.696237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:17.697536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.698253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:17.765226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:17.769866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:17.776685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-698ad943-58f1-40ff-bee6-0e3b81a23fec tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.099152 Jun 17 13:17:17.777465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1278/2459] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:17.997734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d3d6dbba-bae9-450d-ac50-6605c0243e8f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:17.998694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d3d6dbba-bae9-450d-ac50-6605c0243e8f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:18.007356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3d6dbba-bae9-450d-ac50-6605c0243e8f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.007838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3d6dbba-bae9-450d-ac50-6605c0243e8f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.009240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3d6dbba-bae9-450d-ac50-6605c0243e8f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.009724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3d6dbba-bae9-450d-ac50-6605c0243e8f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.046280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d3d6dbba-bae9-450d-ac50-6605c0243e8f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052622 Jun 17 13:17:18.046851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1182/2460] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:18.321230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9fa34a79-ebd3-4713-bf47-1d59ea151589 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:18.322590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9fa34a79-ebd3-4713-bf47-1d59ea151589 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:18.333990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fa34a79-ebd3-4713-bf47-1d59ea151589 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.334797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fa34a79-ebd3-4713-bf47-1d59ea151589 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.336148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fa34a79-ebd3-4713-bf47-1d59ea151589 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.336855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fa34a79-ebd3-4713-bf47-1d59ea151589 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.369978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9fa34a79-ebd3-4713-bf47-1d59ea151589 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056011 Jun 17 13:17:18.370538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1279/2461] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:18.799649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:18.800614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:18.809609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.810180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.810974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.811673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.883463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:18.895175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f43a5a85-434f-4f80-bad9-b61652a4d7ad tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100019 Jun 17 13:17:18.895907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1183/2462] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:19.062743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2a9540c3-05c8-47a8-a6fe-3533a167e581 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:19.064080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2a9540c3-05c8-47a8-a6fe-3533a167e581 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:19.073224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9540c3-05c8-47a8-a6fe-3533a167e581 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.073676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9540c3-05c8-47a8-a6fe-3533a167e581 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.074444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9540c3-05c8-47a8-a6fe-3533a167e581 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.074875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9540c3-05c8-47a8-a6fe-3533a167e581 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.107540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2a9540c3-05c8-47a8-a6fe-3533a167e581 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052899 Jun 17 13:17:19.108169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1280/2463] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:19 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:19.386155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e93c75b4-1d17-45ac-aef5-2c6d75a8f511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:19.387263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e93c75b4-1d17-45ac-aef5-2c6d75a8f511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:19.395079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e93c75b4-1d17-45ac-aef5-2c6d75a8f511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.395636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e93c75b4-1d17-45ac-aef5-2c6d75a8f511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.396406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e93c75b4-1d17-45ac-aef5-2c6d75a8f511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.398947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e93c75b4-1d17-45ac-aef5-2c6d75a8f511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.434728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e93c75b4-1d17-45ac-aef5-2c6d75a8f511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052739 Jun 17 13:17:19.435306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1184/2464] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:19.916133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:19.916754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:19.923841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.924292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.925040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.925552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.991288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:20.002333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5066c9cd-7ee1-4666-8a88-ed27dd61e7d2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090190 Jun 17 13:17:20.002900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1281/2465] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:20.118886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-645660f4-2314-46ad-bd59-f7f17264d939 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:20.119844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-645660f4-2314-46ad-bd59-f7f17264d939 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:20.127079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-645660f4-2314-46ad-bd59-f7f17264d939 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.127546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-645660f4-2314-46ad-bd59-f7f17264d939 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.128306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-645660f4-2314-46ad-bd59-f7f17264d939 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.128737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-645660f4-2314-46ad-bd59-f7f17264d939 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.158159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-645660f4-2314-46ad-bd59-f7f17264d939 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 Jun 17 13:17:20.158721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1185/2466] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:20 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:20.449792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bebb724c-7802-49ce-907a-396f4ab42c75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:20.451221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bebb724c-7802-49ce-907a-396f4ab42c75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:20.458466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bebb724c-7802-49ce-907a-396f4ab42c75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.458910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bebb724c-7802-49ce-907a-396f4ab42c75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.459700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bebb724c-7802-49ce-907a-396f4ab42c75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.460133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bebb724c-7802-49ce-907a-396f4ab42c75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.490114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bebb724c-7802-49ce-907a-396f4ab42c75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046520 Jun 17 13:17:20.490669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1282/2467] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:21.024395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:21.025360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:21.036753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.037494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.038731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.039486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.045991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:21.107157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:21.115981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a744e7fd-2ff9-49db-b317-c805678ddd41 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097980 Jun 17 13:17:21.116769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1186/2468] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:21 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:21.173716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95ad1f91-e0fc-4d47-87b0-9e89f44835de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:21.174669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95ad1f91-e0fc-4d47-87b0-9e89f44835de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:21.182643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ad1f91-e0fc-4d47-87b0-9e89f44835de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.183141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ad1f91-e0fc-4d47-87b0-9e89f44835de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.184004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ad1f91-e0fc-4d47-87b0-9e89f44835de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.184486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ad1f91-e0fc-4d47-87b0-9e89f44835de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.216800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95ad1f91-e0fc-4d47-87b0-9e89f44835de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048662 Jun 17 13:17:21.217355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1283/2469] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:21.508485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-877ba2e6-fb3f-463f-8d64-b07100163e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:21.509933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-877ba2e6-fb3f-463f-8d64-b07100163e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:21.519576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-877ba2e6-fb3f-463f-8d64-b07100163e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.520160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-877ba2e6-fb3f-463f-8d64-b07100163e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.521000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-877ba2e6-fb3f-463f-8d64-b07100163e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.521584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-877ba2e6-fb3f-463f-8d64-b07100163e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.554996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-877ba2e6-fb3f-463f-8d64-b07100163e3f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053164 Jun 17 13:17:21.555579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1187/2470] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:22.136904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:22.137736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:22.147947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.148509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.149662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.150293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.225997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:22.229074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5d877a5a-5a21-42bd-b14b-825be5c677bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:22.230085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5d877a5a-5a21-42bd-b14b-825be5c677bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:22.234359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8fe6cd0f-9567-44ce-a00c-0de2801d9413 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.103790 Jun 17 13:17:22.234922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1284/2471] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:17:22.237430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d877a5a-5a21-42bd-b14b-825be5c677bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.237886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d877a5a-5a21-42bd-b14b-825be5c677bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.238657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d877a5a-5a21-42bd-b14b-825be5c677bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.239094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5d877a5a-5a21-42bd-b14b-825be5c677bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.269091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5d877a5a-5a21-42bd-b14b-825be5c677bd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Jun 17 13:17:22.269647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1188/2472] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:22 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:22.569179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4074a523-2140-45f7-8a2e-c43a4bb832b5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:22.570477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4074a523-2140-45f7-8a2e-c43a4bb832b5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:22.579601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4074a523-2140-45f7-8a2e-c43a4bb832b5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.580316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4074a523-2140-45f7-8a2e-c43a4bb832b5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.581139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4074a523-2140-45f7-8a2e-c43a4bb832b5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.581589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4074a523-2140-45f7-8a2e-c43a4bb832b5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.621678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4074a523-2140-45f7-8a2e-c43a4bb832b5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058253 Jun 17 13:17:22.622236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1285/2473] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:23.256339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:23.257338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:23.268546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.268998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.269757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.270197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.281559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-65cbee93-6372-4df0-b26d-a67aaa147be0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:23.282479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-65cbee93-6372-4df0-b26d-a67aaa147be0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:23.289498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cbee93-6372-4df0-b26d-a67aaa147be0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.289939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cbee93-6372-4df0-b26d-a67aaa147be0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.290753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cbee93-6372-4df0-b26d-a67aaa147be0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.291270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65cbee93-6372-4df0-b26d-a67aaa147be0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.323253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-65cbee93-6372-4df0-b26d-a67aaa147be0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Jun 17 13:17:23.323907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1286/2474] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:23 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:23.337288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:23.347913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f4c2e40b-6b37-433a-a177-c105f96bfc40 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098109 Jun 17 13:17:23.348449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1189/2475] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:23.638901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3590ee76-89a1-46da-a669-0be9c5a2f253 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:23.640436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3590ee76-89a1-46da-a669-0be9c5a2f253 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:23.651518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3590ee76-89a1-46da-a669-0be9c5a2f253 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.652167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3590ee76-89a1-46da-a669-0be9c5a2f253 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.653402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3590ee76-89a1-46da-a669-0be9c5a2f253 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.654107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3590ee76-89a1-46da-a669-0be9c5a2f253 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.686708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3590ee76-89a1-46da-a669-0be9c5a2f253 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054374 Jun 17 13:17:23.687268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1287/2476] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:24.336082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-04470925-67ff-4aed-a09f-a2897d95ad53 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:24.337016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-04470925-67ff-4aed-a09f-a2897d95ad53 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:24.344018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04470925-67ff-4aed-a09f-a2897d95ad53 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.344462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04470925-67ff-4aed-a09f-a2897d95ad53 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.345219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04470925-67ff-4aed-a09f-a2897d95ad53 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.345651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04470925-67ff-4aed-a09f-a2897d95ad53 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.365160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:24.365723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:24.372278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.372727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.373598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.374441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.376662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-04470925-67ff-4aed-a09f-a2897d95ad53 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Jun 17 13:17:24.377229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1190/2477] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:24.440993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:24.449409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f854cddf-b526-47e8-8f19-e7f2766b3d9c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088502 Jun 17 13:17:24.449972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1288/2478] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:24.699761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd508045-1e06-44cd-8f07-5fa3a680d036 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:24.700626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd508045-1e06-44cd-8f07-5fa3a680d036 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:24.707166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd508045-1e06-44cd-8f07-5fa3a680d036 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.708194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd508045-1e06-44cd-8f07-5fa3a680d036 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.709235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd508045-1e06-44cd-8f07-5fa3a680d036 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.709670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd508045-1e06-44cd-8f07-5fa3a680d036 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.741276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd508045-1e06-44cd-8f07-5fa3a680d036 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Jun 17 13:17:24.741813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1191/2479] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:25.391167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-056614d9-d085-4233-a2e4-1545a3bf0ec3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:25.392304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-056614d9-d085-4233-a2e4-1545a3bf0ec3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:25.400664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-056614d9-d085-4233-a2e4-1545a3bf0ec3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.401114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-056614d9-d085-4233-a2e4-1545a3bf0ec3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.401876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-056614d9-d085-4233-a2e4-1545a3bf0ec3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.402308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-056614d9-d085-4233-a2e4-1545a3bf0ec3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.432229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-056614d9-d085-4233-a2e4-1545a3bf0ec3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Jun 17 13:17:25.432799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1289/2480] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:25 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:25.466726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:25.467359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:25.474853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.475305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.476309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.476740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.543037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:25.551146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6695dfa3-f8fe-4ab5-94e3-0f4b7940042c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088831 Jun 17 13:17:25.551778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1192/2481] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:25.756428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-16659abb-17fb-46c3-94e4-a036fa0d6285 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:25.757398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-16659abb-17fb-46c3-94e4-a036fa0d6285 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:25.764164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16659abb-17fb-46c3-94e4-a036fa0d6285 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.764633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16659abb-17fb-46c3-94e4-a036fa0d6285 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.765376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16659abb-17fb-46c3-94e4-a036fa0d6285 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.765799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-16659abb-17fb-46c3-94e4-a036fa0d6285 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.796482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-16659abb-17fb-46c3-94e4-a036fa0d6285 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046169 Jun 17 13:17:25.797027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1290/2482] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:25 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:26.443971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dd61fb75-e5b3-4315-a89e-4d771d5022de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:26.444821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dd61fb75-e5b3-4315-a89e-4d771d5022de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:26.452931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd61fb75-e5b3-4315-a89e-4d771d5022de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.453373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd61fb75-e5b3-4315-a89e-4d771d5022de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.454201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd61fb75-e5b3-4315-a89e-4d771d5022de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.454639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd61fb75-e5b3-4315-a89e-4d771d5022de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.484643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dd61fb75-e5b3-4315-a89e-4d771d5022de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Jun 17 13:17:26.485354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1193/2483] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:26.571683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:26.572411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:26.579966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.580409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.581160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.581615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.655662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:26.666248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-50cf6db0-0186-4825-b3a2-a5a2e644c47d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100496 Jun 17 13:17:26.666984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1291/2484] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:26.811154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-929b2422-5fdb-4144-adec-7210a24ce11e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:26.812105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-929b2422-5fdb-4144-adec-7210a24ce11e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:26.820025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-929b2422-5fdb-4144-adec-7210a24ce11e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.820604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-929b2422-5fdb-4144-adec-7210a24ce11e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.821786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-929b2422-5fdb-4144-adec-7210a24ce11e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.822956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-929b2422-5fdb-4144-adec-7210a24ce11e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.853331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-929b2422-5fdb-4144-adec-7210a24ce11e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Jun 17 13:17:26.853890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1194/2485] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:27.497158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c4e0bfd0-cab6-40b8-8b11-612ad64e405d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:27.498095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c4e0bfd0-cab6-40b8-8b11-612ad64e405d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:27.504966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e0bfd0-cab6-40b8-8b11-612ad64e405d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.505409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e0bfd0-cab6-40b8-8b11-612ad64e405d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.506136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e0bfd0-cab6-40b8-8b11-612ad64e405d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.506560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e0bfd0-cab6-40b8-8b11-612ad64e405d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.536073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c4e0bfd0-cab6-40b8-8b11-612ad64e405d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Jun 17 13:17:27.536617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1292/2486] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:27.686595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:27.687501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:27.697819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.698508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.699740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.700403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.767860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:27.775941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df8d568b-168f-4b3e-ad41-e1edd3f0e9a5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095107 Jun 17 13:17:27.776501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1195/2487] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:27.867225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-12240258-71fd-458d-bbe5-c5f2cd035920 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:27.868201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-12240258-71fd-458d-bbe5-c5f2cd035920 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:27.876779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12240258-71fd-458d-bbe5-c5f2cd035920 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.877367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12240258-71fd-458d-bbe5-c5f2cd035920 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.878502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12240258-71fd-458d-bbe5-c5f2cd035920 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.878960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12240258-71fd-458d-bbe5-c5f2cd035920 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.915930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-12240258-71fd-458d-bbe5-c5f2cd035920 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052831 Jun 17 13:17:27.916500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1293/2488] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:28.550493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-120c9686-1bec-4c7e-8b73-b987b304be99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:28.551811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-120c9686-1bec-4c7e-8b73-b987b304be99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:28.559568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-120c9686-1bec-4c7e-8b73-b987b304be99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.559848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-120c9686-1bec-4c7e-8b73-b987b304be99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.560588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-120c9686-1bec-4c7e-8b73-b987b304be99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.561023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-120c9686-1bec-4c7e-8b73-b987b304be99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.590986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-120c9686-1bec-4c7e-8b73-b987b304be99 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046050 Jun 17 13:17:28.591571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1196/2489] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:28.798518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:28.799539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:28.810163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.810791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.812074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.812778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.879032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:28.887148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1ea45004-4e97-4206-aaf8-08515158e4da tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096572 Jun 17 13:17:28.887746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1294/2490] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:28.929706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-06677dc5-69b5-400e-857e-c148e787301b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:28.930640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-06677dc5-69b5-400e-857e-c148e787301b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:28.937705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06677dc5-69b5-400e-857e-c148e787301b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.938155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06677dc5-69b5-400e-857e-c148e787301b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.938913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06677dc5-69b5-400e-857e-c148e787301b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.939350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06677dc5-69b5-400e-857e-c148e787301b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.969981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-06677dc5-69b5-400e-857e-c148e787301b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Jun 17 13:17:28.970537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1197/2491] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:29.605640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e4934ac5-f589-4cc6-8213-536378f1719e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:29.606573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e4934ac5-f589-4cc6-8213-536378f1719e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:29.613159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e4934ac5-f589-4cc6-8213-536378f1719e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.613518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e4934ac5-f589-4cc6-8213-536378f1719e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.614297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e4934ac5-f589-4cc6-8213-536378f1719e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.614767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e4934ac5-f589-4cc6-8213-536378f1719e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.632641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:29.646795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e4934ac5-f589-4cc6-8213-536378f1719e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046727 Jun 17 13:17:29.647360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1295/2492] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:29 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:29.908944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:29.909836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:29.920421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.921138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.922383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.923083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.982653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-980d6cb9-bad9-44ee-95f5-ad374cb8dbc1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:29.983744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-980d6cb9-bad9-44ee-95f5-ad374cb8dbc1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:29.990618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:30.000213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-980d6cb9-bad9-44ee-95f5-ad374cb8dbc1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.000213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-980d6cb9-bad9-44ee-95f5-ad374cb8dbc1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.000213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-980d6cb9-bad9-44ee-95f5-ad374cb8dbc1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.000213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-980d6cb9-bad9-44ee-95f5-ad374cb8dbc1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.003668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f1cc9c0b-c728-4c92-9011-950e8fd6ff17 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100804 Jun 17 13:17:30.004960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1198/2493] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:30.028322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-980d6cb9-bad9-44ee-95f5-ad374cb8dbc1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049932 Jun 17 13:17:30.028883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1296/2494] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:30.659028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ccd9ca68-2f68-4b59-80af-2597d40423ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:30.659998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ccd9ca68-2f68-4b59-80af-2597d40423ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:30.666376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccd9ca68-2f68-4b59-80af-2597d40423ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.666877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccd9ca68-2f68-4b59-80af-2597d40423ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.667698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccd9ca68-2f68-4b59-80af-2597d40423ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.668121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccd9ca68-2f68-4b59-80af-2597d40423ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.697558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ccd9ca68-2f68-4b59-80af-2597d40423ff tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Jun 17 13:17:30.698156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1199/2495] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:30 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:31.023974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:31.024710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:31.032895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.033423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.034185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.034620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.040870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d2e81ae0-9ab2-4e59-ad3c-9a45a27249fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:31.041815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d2e81ae0-9ab2-4e59-ad3c-9a45a27249fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:31.049294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2e81ae0-9ab2-4e59-ad3c-9a45a27249fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.049736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2e81ae0-9ab2-4e59-ad3c-9a45a27249fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.050500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2e81ae0-9ab2-4e59-ad3c-9a45a27249fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.050925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2e81ae0-9ab2-4e59-ad3c-9a45a27249fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.081220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d2e81ae0-9ab2-4e59-ad3c-9a45a27249fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Jun 17 13:17:31.081831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1200/2496] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:31.100878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:31.110209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f25d642-28cc-40c8-8752-c1a4f904415e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092381 Jun 17 13:17:31.110775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1297/2497] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:31.713742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f8d60eca-4478-481a-8c71-6f3442e9bbc4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:31.715245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f8d60eca-4478-481a-8c71-6f3442e9bbc4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:31.725888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d60eca-4478-481a-8c71-6f3442e9bbc4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.726637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d60eca-4478-481a-8c71-6f3442e9bbc4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.727946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d60eca-4478-481a-8c71-6f3442e9bbc4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.728673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d60eca-4478-481a-8c71-6f3442e9bbc4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.760749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f8d60eca-4478-481a-8c71-6f3442e9bbc4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053688 Jun 17 13:17:31.761299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1201/2498] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:32.097790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-790a95a2-0823-4dd6-95b1-ca6c51545b25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:32.099238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-790a95a2-0823-4dd6-95b1-ca6c51545b25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:32.110989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-790a95a2-0823-4dd6-95b1-ca6c51545b25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.111801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-790a95a2-0823-4dd6-95b1-ca6c51545b25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.113063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-790a95a2-0823-4dd6-95b1-ca6c51545b25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.113785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-790a95a2-0823-4dd6-95b1-ca6c51545b25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.128489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:32.129127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:32.136022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.136990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.138265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.138716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.146948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-790a95a2-0823-4dd6-95b1-ca6c51545b25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056072 Jun 17 13:17:32.147548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1298/2499] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:32.209017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:32.212008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:32.217933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-82a0ab9a-062f-4da8-8924-3235717a51b8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093421 Jun 17 13:17:32.218544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1202/2500] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:17:32.778003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d1c8f838-e852-4dc2-9711-3b2f1dfa0854 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:32.779215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d1c8f838-e852-4dc2-9711-3b2f1dfa0854 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:32.785994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f838-e852-4dc2-9711-3b2f1dfa0854 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.786432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f838-e852-4dc2-9711-3b2f1dfa0854 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.787182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f838-e852-4dc2-9711-3b2f1dfa0854 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.787642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f838-e852-4dc2-9711-3b2f1dfa0854 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.819857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d1c8f838-e852-4dc2-9711-3b2f1dfa0854 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048876 Jun 17 13:17:32.820408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1299/2501] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:32 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:33.159014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-21e24bda-8878-4aa6-ad3d-375c41e74381 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:33.160381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-21e24bda-8878-4aa6-ad3d-375c41e74381 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:33.168283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21e24bda-8878-4aa6-ad3d-375c41e74381 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.168727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21e24bda-8878-4aa6-ad3d-375c41e74381 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.169790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21e24bda-8878-4aa6-ad3d-375c41e74381 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.170269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21e24bda-8878-4aa6-ad3d-375c41e74381 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.203820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-21e24bda-8878-4aa6-ad3d-375c41e74381 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049241 Jun 17 13:17:33.204379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1203/2502] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:33.235104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:33.235691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:33.238030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=86 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:33.243593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.244064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.244788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.245212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.310763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:33.318553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-50964d61-89a7-482b-a247-379baf7e6ccd tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087460 Jun 17 13:17:33.319107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1300/2503] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:33.835342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3fb23a2c-93f4-46a8-87af-fb9d55a15c65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:33.836650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3fb23a2c-93f4-46a8-87af-fb9d55a15c65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:33.845160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fb23a2c-93f4-46a8-87af-fb9d55a15c65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.845645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fb23a2c-93f4-46a8-87af-fb9d55a15c65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.846758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fb23a2c-93f4-46a8-87af-fb9d55a15c65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.847342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3fb23a2c-93f4-46a8-87af-fb9d55a15c65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.880197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3fb23a2c-93f4-46a8-87af-fb9d55a15c65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051134 Jun 17 13:17:33.880753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1204/2504] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:33 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:34.219879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e00b277b-9105-47b3-8b4b-2dfacc3dd633 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:34.220807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e00b277b-9105-47b3-8b4b-2dfacc3dd633 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:34.227457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00b277b-9105-47b3-8b4b-2dfacc3dd633 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.227911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00b277b-9105-47b3-8b4b-2dfacc3dd633 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.228666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00b277b-9105-47b3-8b4b-2dfacc3dd633 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.229094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e00b277b-9105-47b3-8b4b-2dfacc3dd633 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.260865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e00b277b-9105-47b3-8b4b-2dfacc3dd633 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 Jun 17 13:17:34.261523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1301/2505] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:34.339783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:34.341067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:34.349215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.349653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.350677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.351104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.417200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:34.425934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-68ec8d41-2fe2-49ba-bfba-d370be2195b3 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092738 Jun 17 13:17:34.426513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1205/2506] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:34.894520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-411b55f2-e306-4add-af2d-a519fd67a7fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:34.895699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-411b55f2-e306-4add-af2d-a519fd67a7fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:34.903611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-411b55f2-e306-4add-af2d-a519fd67a7fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.904170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-411b55f2-e306-4add-af2d-a519fd67a7fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.905114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-411b55f2-e306-4add-af2d-a519fd67a7fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.905658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-411b55f2-e306-4add-af2d-a519fd67a7fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.939326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-411b55f2-e306-4add-af2d-a519fd67a7fa tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049856 Jun 17 13:17:34.939908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1302/2507] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:34 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:35.278450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b620117c-4a90-4e96-b7c3-6180784b656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:35.280259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b620117c-4a90-4e96-b7c3-6180784b656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:35.290565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b620117c-4a90-4e96-b7c3-6180784b656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.291310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b620117c-4a90-4e96-b7c3-6180784b656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.292616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b620117c-4a90-4e96-b7c3-6180784b656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.293317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b620117c-4a90-4e96-b7c3-6180784b656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.323317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b620117c-4a90-4e96-b7c3-6180784b656f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051779 Jun 17 13:17:35.323891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1206/2508] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:35.449177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:35.450042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:35.457649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.458111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.458861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.459296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.524742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:35.532894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-24df59b2-d838-4d92-a094-cbf6e51820c7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088978 Jun 17 13:17:35.533390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1303/2509] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:17:35.955558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-466645dd-f027-4e46-b5db-9cfcd8d7aadc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:35.957104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-466645dd-f027-4e46-b5db-9cfcd8d7aadc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:35.968064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-466645dd-f027-4e46-b5db-9cfcd8d7aadc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.968514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-466645dd-f027-4e46-b5db-9cfcd8d7aadc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.969264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-466645dd-f027-4e46-b5db-9cfcd8d7aadc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.969719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-466645dd-f027-4e46-b5db-9cfcd8d7aadc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.999249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-466645dd-f027-4e46-b5db-9cfcd8d7aadc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050093 Jun 17 13:17:35.999914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1207/2510] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:35 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:36.339524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5913dd2c-76ec-4d8e-a12a-ef59d799c445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:36.341016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5913dd2c-76ec-4d8e-a12a-ef59d799c445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:36.351607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5913dd2c-76ec-4d8e-a12a-ef59d799c445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:36.352349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5913dd2c-76ec-4d8e-a12a-ef59d799c445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:36.353597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5913dd2c-76ec-4d8e-a12a-ef59d799c445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:36.354327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5913dd2c-76ec-4d8e-a12a-ef59d799c445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:36.388089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5913dd2c-76ec-4d8e-a12a-ef59d799c445 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054979 Jun 17 13:17:36.388824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1304/2511] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:36.554295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:36.555285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:36.564471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:36.564913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:36.565664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:36.566085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:36.641123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:36.652696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d202fc2e-ac40-4f92-9591-06e6a370ee58 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.105060 Jun 17 13:17:36.653306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1208/2512] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:37.011330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1fa163c7-4b8d-46ff-b629-1cea8ba84d13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:37.012304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1fa163c7-4b8d-46ff-b629-1cea8ba84d13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:37.020210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fa163c7-4b8d-46ff-b629-1cea8ba84d13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.020634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fa163c7-4b8d-46ff-b629-1cea8ba84d13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.021395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fa163c7-4b8d-46ff-b629-1cea8ba84d13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.021826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fa163c7-4b8d-46ff-b629-1cea8ba84d13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.052006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1fa163c7-4b8d-46ff-b629-1cea8ba84d13 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Jun 17 13:17:37.052546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1305/2513] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:37 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:37.404644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4578805b-c51a-4bc7-a938-22e29c79c2f5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:37.406206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4578805b-c51a-4bc7-a938-22e29c79c2f5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:37.412986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4578805b-c51a-4bc7-a938-22e29c79c2f5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.413423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4578805b-c51a-4bc7-a938-22e29c79c2f5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.414169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4578805b-c51a-4bc7-a938-22e29c79c2f5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.414592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4578805b-c51a-4bc7-a938-22e29c79c2f5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.444943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4578805b-c51a-4bc7-a938-22e29c79c2f5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047001 Jun 17 13:17:37.445491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1209/2514] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:37.673823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:37.674335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:37.681071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.681517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.682263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.682694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.753321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:37.761634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-548407af-0415-4052-aba8-bf0db2721c02 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093544 Jun 17 13:17:37.762219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1306/2515] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:38.068190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-944c1651-6cfc-45bb-aeeb-0e4e67b35aea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:38.069692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-944c1651-6cfc-45bb-aeeb-0e4e67b35aea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:38.081330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-944c1651-6cfc-45bb-aeeb-0e4e67b35aea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.082078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-944c1651-6cfc-45bb-aeeb-0e4e67b35aea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.083302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-944c1651-6cfc-45bb-aeeb-0e4e67b35aea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.084054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-944c1651-6cfc-45bb-aeeb-0e4e67b35aea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.126868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-944c1651-6cfc-45bb-aeeb-0e4e67b35aea tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065342 Jun 17 13:17:38.127471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1210/2516] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:38 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:38.458839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84613687-f46a-4cff-9a0a-91f33fe5400e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:38.460137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-84613687-f46a-4cff-9a0a-91f33fe5400e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:38.469563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84613687-f46a-4cff-9a0a-91f33fe5400e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.470184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84613687-f46a-4cff-9a0a-91f33fe5400e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.471222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84613687-f46a-4cff-9a0a-91f33fe5400e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.471857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84613687-f46a-4cff-9a0a-91f33fe5400e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.505529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-84613687-f46a-4cff-9a0a-91f33fe5400e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052057 Jun 17 13:17:38.506110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1307/2517] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:38.779146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:38.779794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:38.786962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.787399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.788176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.788601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.855345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:38.863638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f42410b4-73b9-41ce-bb85-519031c08add tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088393 Jun 17 13:17:38.864203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1211/2518] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:39.141071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-13f50638-5f0b-444f-b6cd-dc95f919082d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:39.142072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-13f50638-5f0b-444f-b6cd-dc95f919082d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:39.148266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13f50638-5f0b-444f-b6cd-dc95f919082d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.148703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13f50638-5f0b-444f-b6cd-dc95f919082d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.149444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13f50638-5f0b-444f-b6cd-dc95f919082d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.149871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-13f50638-5f0b-444f-b6cd-dc95f919082d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.179776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-13f50638-5f0b-444f-b6cd-dc95f919082d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Jun 17 13:17:39.180505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1308/2519] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:39 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:39.518215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d8729b18-9af3-4c6b-9b9c-a2d071ed71aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:39.519151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d8729b18-9af3-4c6b-9b9c-a2d071ed71aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:39.525939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8729b18-9af3-4c6b-9b9c-a2d071ed71aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.526384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8729b18-9af3-4c6b-9b9c-a2d071ed71aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.527144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8729b18-9af3-4c6b-9b9c-a2d071ed71aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.527607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8729b18-9af3-4c6b-9b9c-a2d071ed71aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.557594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d8729b18-9af3-4c6b-9b9c-a2d071ed71aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 Jun 17 13:17:39.558161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1212/2520] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:39.885793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:39.886745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:39.895304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.895771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.896518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.896935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.965774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:39.973975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-33ac720d-ca43-476a-812c-0537b6e564ea tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094806 Jun 17 13:17:39.974547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1309/2521] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:40.196554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c825c569-48e4-4c70-ae3e-b05f0d314d54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:40.197470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c825c569-48e4-4c70-ae3e-b05f0d314d54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:40.207076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c825c569-48e4-4c70-ae3e-b05f0d314d54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.207608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c825c569-48e4-4c70-ae3e-b05f0d314d54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.208583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c825c569-48e4-4c70-ae3e-b05f0d314d54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.209148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c825c569-48e4-4c70-ae3e-b05f0d314d54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.242062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c825c569-48e4-4c70-ae3e-b05f0d314d54 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052150 Jun 17 13:17:40.242599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1213/2522] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:40 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:40.572285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bffeb60d-0828-4e12-938b-423706df8d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:40.573580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bffeb60d-0828-4e12-938b-423706df8d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:40.581934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bffeb60d-0828-4e12-938b-423706df8d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.582385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bffeb60d-0828-4e12-938b-423706df8d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.583147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bffeb60d-0828-4e12-938b-423706df8d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.583621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bffeb60d-0828-4e12-938b-423706df8d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.614897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bffeb60d-0828-4e12-938b-423706df8d1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Jun 17 13:17:40.615474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1310/2523] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:40.995509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:40.996580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:41.000726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=84 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:41.007071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.007545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.008304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.008716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.080016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:41.091171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-97f3a9d4-5503-4bac-938b-ff9885046041 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.101819 Jun 17 13:17:41.091956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1214/2524] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:40 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:41.258614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-719644ec-0d35-49d1-8a24-bfd741306d45 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:41.260201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-719644ec-0d35-49d1-8a24-bfd741306d45 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:41.270073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-719644ec-0d35-49d1-8a24-bfd741306d45 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.270503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-719644ec-0d35-49d1-8a24-bfd741306d45 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.271327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-719644ec-0d35-49d1-8a24-bfd741306d45 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.271795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-719644ec-0d35-49d1-8a24-bfd741306d45 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.305380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-719644ec-0d35-49d1-8a24-bfd741306d45 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053859 Jun 17 13:17:41.305939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1311/2525] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:41 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:41.630758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd808364-4238-4a1e-8464-628a171fa52a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:41.631763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd808364-4238-4a1e-8464-628a171fa52a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:41.639262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd808364-4238-4a1e-8464-628a171fa52a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.639832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd808364-4238-4a1e-8464-628a171fa52a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.640730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd808364-4238-4a1e-8464-628a171fa52a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.641239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd808364-4238-4a1e-8464-628a171fa52a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.673591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd808364-4238-4a1e-8464-628a171fa52a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048759 Jun 17 13:17:41.674139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1215/2526] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:42.112373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:42.112987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:42.119700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.120147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.120915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.121347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.125785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:42.192311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:42.200709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-087ae4b2-64d2-4f0c-be91-4758ab56f601 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094735 Jun 17 13:17:42.201276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1312/2527] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:42.319015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-537ab460-95ba-404b-a2ac-9e5ae0aa9203 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:42.319993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-537ab460-95ba-404b-a2ac-9e5ae0aa9203 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:42.327777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537ab460-95ba-404b-a2ac-9e5ae0aa9203 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.328542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537ab460-95ba-404b-a2ac-9e5ae0aa9203 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.328915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537ab460-95ba-404b-a2ac-9e5ae0aa9203 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.329383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537ab460-95ba-404b-a2ac-9e5ae0aa9203 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.361627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-537ab460-95ba-404b-a2ac-9e5ae0aa9203 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Jun 17 13:17:42.361947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1216/2528] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:42 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:42.685725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cf2a9d65-d42c-4de4-a482-a471cbb27f4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:42.686655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cf2a9d65-d42c-4de4-a482-a471cbb27f4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:42.695138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf2a9d65-d42c-4de4-a482-a471cbb27f4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.695939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf2a9d65-d42c-4de4-a482-a471cbb27f4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.697194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf2a9d65-d42c-4de4-a482-a471cbb27f4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.697917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf2a9d65-d42c-4de4-a482-a471cbb27f4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.731401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cf2a9d65-d42c-4de4-a482-a471cbb27f4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049667 Jun 17 13:17:42.731944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1313/2529] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:43.222522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:43.223232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:43.231496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.231991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.232965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.233500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.302625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:43.310343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-21af3ff3-4814-4c4b-a798-04fcdacc36ed tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094903 Jun 17 13:17:43.310906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1217/2530] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:43.374517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cf0f3ee3-2eda-4d8c-ae89-6cd6f722e09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:43.375396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cf0f3ee3-2eda-4d8c-ae89-6cd6f722e09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:43.382244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0f3ee3-2eda-4d8c-ae89-6cd6f722e09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.382725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0f3ee3-2eda-4d8c-ae89-6cd6f722e09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.383493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0f3ee3-2eda-4d8c-ae89-6cd6f722e09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.383942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf0f3ee3-2eda-4d8c-ae89-6cd6f722e09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.413535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cf0f3ee3-2eda-4d8c-ae89-6cd6f722e09f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 Jun 17 13:17:43.414087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1314/2531] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:43 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:43.750246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6bd79186-280f-4cec-85d7-37f5e94c39f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:43.752000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6bd79186-280f-4cec-85d7-37f5e94c39f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:43.763282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6bd79186-280f-4cec-85d7-37f5e94c39f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.764087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6bd79186-280f-4cec-85d7-37f5e94c39f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.765343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6bd79186-280f-4cec-85d7-37f5e94c39f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.766063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6bd79186-280f-4cec-85d7-37f5e94c39f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.797189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6bd79186-280f-4cec-85d7-37f5e94c39f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054258 Jun 17 13:17:43.797744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1218/2532] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:43 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:44.328473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:44.329096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:44.337044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.337477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.338231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.338660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.404364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:44.416174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2e321014-7164-4a8f-bd20-3261c53eb542 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091327 Jun 17 13:17:44.416993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1315/2533] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:44.425867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-650c9fae-2772-42f5-bcad-4e1d408d6ace tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:44.427695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-650c9fae-2772-42f5-bcad-4e1d408d6ace tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:44.437084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-650c9fae-2772-42f5-bcad-4e1d408d6ace tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.437703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-650c9fae-2772-42f5-bcad-4e1d408d6ace tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.438797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-650c9fae-2772-42f5-bcad-4e1d408d6ace tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.439309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-650c9fae-2772-42f5-bcad-4e1d408d6ace tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.463851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:44.477536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-650c9fae-2772-42f5-bcad-4e1d408d6ace tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055606 Jun 17 13:17:44.478096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1219/2534] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:44 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:44.813836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0bdd41df-877a-4cf0-8c17-c40e71561311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:44.815340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0bdd41df-877a-4cf0-8c17-c40e71561311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:44.823022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd41df-877a-4cf0-8c17-c40e71561311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.823493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd41df-877a-4cf0-8c17-c40e71561311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.824247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd41df-877a-4cf0-8c17-c40e71561311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.824676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd41df-877a-4cf0-8c17-c40e71561311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.855337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0bdd41df-877a-4cf0-8c17-c40e71561311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048223 Jun 17 13:17:44.855930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1316/2535] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:45.438434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:45.439273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:45.448333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.448780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.449532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.449966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.490038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-131ad913-86b3-4804-b170-a3df3a3911a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:45.491086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-131ad913-86b3-4804-b170-a3df3a3911a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:45.499675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131ad913-86b3-4804-b170-a3df3a3911a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.500420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131ad913-86b3-4804-b170-a3df3a3911a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.501744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131ad913-86b3-4804-b170-a3df3a3911a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.502465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-131ad913-86b3-4804-b170-a3df3a3911a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.518229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:45.526470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2e896db5-1a32-4afe-9855-024c3a42a599 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094636 Jun 17 13:17:45.527053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1220/2536] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:45.534186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-131ad913-86b3-4804-b170-a3df3a3911a0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048057 Jun 17 13:17:45.534725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1317/2537] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:45 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:45.868272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e75e38ce-d1b0-4e69-8a06-2d7fe072311a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:45.869293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e75e38ce-d1b0-4e69-8a06-2d7fe072311a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:45.876554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75e38ce-d1b0-4e69-8a06-2d7fe072311a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.877021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75e38ce-d1b0-4e69-8a06-2d7fe072311a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.877777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75e38ce-d1b0-4e69-8a06-2d7fe072311a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.878207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e75e38ce-d1b0-4e69-8a06-2d7fe072311a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.908990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e75e38ce-d1b0-4e69-8a06-2d7fe072311a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045662 Jun 17 13:17:45.909543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1221/2538] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:46.545614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:46.546378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:46.549281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f785f242-827f-4425-a679-460fce0e0869 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:46.550495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f785f242-827f-4425-a679-460fce0e0869 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:46.555211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.555709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.556478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.556938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.558095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f785f242-827f-4425-a679-460fce0e0869 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.558547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f785f242-827f-4425-a679-460fce0e0869 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.559302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f785f242-827f-4425-a679-460fce0e0869 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.559829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f785f242-827f-4425-a679-460fce0e0869 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.590040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f785f242-827f-4425-a679-460fce0e0869 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Jun 17 13:17:46.590656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1222/2539] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:46 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:46.619312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:46.627733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-18225a62-75b5-44c4-835b-022a79c0222c tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.087288 Jun 17 13:17:46.628328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1318/2540] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:46.926692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7b425572-4659-4883-8dcf-adada42afdd5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:46.928113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7b425572-4659-4883-8dcf-adada42afdd5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:46.938740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b425572-4659-4883-8dcf-adada42afdd5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.939498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b425572-4659-4883-8dcf-adada42afdd5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.940791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b425572-4659-4883-8dcf-adada42afdd5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.941510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b425572-4659-4883-8dcf-adada42afdd5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.972533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7b425572-4659-4883-8dcf-adada42afdd5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052688 Jun 17 13:17:46.973399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1223/2541] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:47.601505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0765c473-f135-429f-b1b0-ce4e89b2e5de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:47.602430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0765c473-f135-429f-b1b0-ce4e89b2e5de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:47.609856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0765c473-f135-429f-b1b0-ce4e89b2e5de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.610290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0765c473-f135-429f-b1b0-ce4e89b2e5de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.611045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0765c473-f135-429f-b1b0-ce4e89b2e5de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.611508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0765c473-f135-429f-b1b0-ce4e89b2e5de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.641308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0765c473-f135-429f-b1b0-ce4e89b2e5de tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Jun 17 13:17:47.641902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1319/2542] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:47 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:47.645128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:47.645795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:47.656249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.656880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.657999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.658598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.722974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:47.731814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1dab09a1-58d6-4ea8-8f6f-ee57829c4f55 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090630 Jun 17 13:17:47.732389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1224/2543] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:47.985166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-687365fe-8ede-4e6c-96af-7cc54c098628 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:47.986094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-687365fe-8ede-4e6c-96af-7cc54c098628 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:47.992787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-687365fe-8ede-4e6c-96af-7cc54c098628 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.993240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-687365fe-8ede-4e6c-96af-7cc54c098628 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.994294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-687365fe-8ede-4e6c-96af-7cc54c098628 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.994741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-687365fe-8ede-4e6c-96af-7cc54c098628 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.025360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-687365fe-8ede-4e6c-96af-7cc54c098628 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Jun 17 13:17:48.026248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1320/2544] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:48.655003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b0896544-0cfb-4a6d-821e-b3cc0ec4bc84 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:48.655964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b0896544-0cfb-4a6d-821e-b3cc0ec4bc84 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:48.662865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0896544-0cfb-4a6d-821e-b3cc0ec4bc84 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.663309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0896544-0cfb-4a6d-821e-b3cc0ec4bc84 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.664088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0896544-0cfb-4a6d-821e-b3cc0ec4bc84 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.664484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0896544-0cfb-4a6d-821e-b3cc0ec4bc84 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.699174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b0896544-0cfb-4a6d-821e-b3cc0ec4bc84 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047903 Jun 17 13:17:48.700076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1225/2545] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:48 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:48.751137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:48.752274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:48.762661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.763411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.764572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.765238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.836457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:48.844988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2e1e24a-ea53-4b52-b671-98f08d9267cb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100257 Jun 17 13:17:48.845525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1321/2546] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:49.037814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e427bdda-1dd6-4fc3-84e8-73b2c0c92c47 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:49.038922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e427bdda-1dd6-4fc3-84e8-73b2c0c92c47 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:49.046627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e427bdda-1dd6-4fc3-84e8-73b2c0c92c47 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.047065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e427bdda-1dd6-4fc3-84e8-73b2c0c92c47 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.047859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e427bdda-1dd6-4fc3-84e8-73b2c0c92c47 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.048285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e427bdda-1dd6-4fc3-84e8-73b2c0c92c47 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.080633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e427bdda-1dd6-4fc3-84e8-73b2c0c92c47 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047281 Jun 17 13:17:49.081219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1226/2547] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:49.715701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f291f4a7-08d9-458a-9739-6a901725c253 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:49.717187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f291f4a7-08d9-458a-9739-6a901725c253 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:49.727793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f291f4a7-08d9-458a-9739-6a901725c253 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.728554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f291f4a7-08d9-458a-9739-6a901725c253 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.729806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f291f4a7-08d9-458a-9739-6a901725c253 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.730548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f291f4a7-08d9-458a-9739-6a901725c253 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.760978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f291f4a7-08d9-458a-9739-6a901725c253 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051985 Jun 17 13:17:49.761699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1322/2548] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:49 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:49.863713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:49.864487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:49.873339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.874349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.875300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.875878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.942201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:49.952451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c151c963-09a1-4f65-b260-0697f38c810e tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093639 Jun 17 13:17:49.953008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1227/2549] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:50.095523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-416e5528-f093-4616-be14-9fc847e23740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:50.096443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-416e5528-f093-4616-be14-9fc847e23740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:50.102688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-416e5528-f093-4616-be14-9fc847e23740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.103137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-416e5528-f093-4616-be14-9fc847e23740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.103916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-416e5528-f093-4616-be14-9fc847e23740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.104350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-416e5528-f093-4616-be14-9fc847e23740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.135426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-416e5528-f093-4616-be14-9fc847e23740 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Jun 17 13:17:50.136011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1323/2550] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:50 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:50.992001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-40e8e044-a451-49f4-9f8a-c49a5558c95a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:50.992731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-40e8e044-a451-49f4-9f8a-c49a5558c95a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:51.000031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40e8e044-a451-49f4-9f8a-c49a5558c95a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.000466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40e8e044-a451-49f4-9f8a-c49a5558c95a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.001189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40e8e044-a451-49f4-9f8a-c49a5558c95a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.001804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-40e8e044-a451-49f4-9f8a-c49a5558c95a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.032542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-40e8e044-a451-49f4-9f8a-c49a5558c95a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260873 Jun 17 13:17:51.033108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1228/2551] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:51.037775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:51.038382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:51.044855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.045287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.046039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.046469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.147499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c85630dd-bad8-401f-9b62-b0ff5083d67a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:51.148418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c85630dd-bad8-401f-9b62-b0ff5083d67a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:51.154945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c85630dd-bad8-401f-9b62-b0ff5083d67a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.155424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c85630dd-bad8-401f-9b62-b0ff5083d67a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.156205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c85630dd-bad8-401f-9b62-b0ff5083d67a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.156645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c85630dd-bad8-401f-9b62-b0ff5083d67a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.188305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c85630dd-bad8-401f-9b62-b0ff5083d67a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044796 Jun 17 13:17:51.188880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1229/2552] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:51.251582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:51.259243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2bdfc94d-639c-4357-b13d-147c211a6b9d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.293612 Jun 17 13:17:51.259815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1324/2553] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:50 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:52.044562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-099caf4a-ae7d-40c0-bc3e-d66ed789c803 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:52.045511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-099caf4a-ae7d-40c0-bc3e-d66ed789c803 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:52.052455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-099caf4a-ae7d-40c0-bc3e-d66ed789c803 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.052922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-099caf4a-ae7d-40c0-bc3e-d66ed789c803 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.053683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-099caf4a-ae7d-40c0-bc3e-d66ed789c803 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.054114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-099caf4a-ae7d-40c0-bc3e-d66ed789c803 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.084505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-099caf4a-ae7d-40c0-bc3e-d66ed789c803 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Jun 17 13:17:52.084996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1230/2554] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:52.200165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5e459ce4-1efc-421e-b834-c184fa3d59b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:52.201086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5e459ce4-1efc-421e-b834-c184fa3d59b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:52.208341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e459ce4-1efc-421e-b834-c184fa3d59b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.209609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e459ce4-1efc-421e-b834-c184fa3d59b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.210410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e459ce4-1efc-421e-b834-c184fa3d59b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.210957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e459ce4-1efc-421e-b834-c184fa3d59b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.241554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5e459ce4-1efc-421e-b834-c184fa3d59b9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Jun 17 13:17:52.242116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1325/2555] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:52.276707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:52.277327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:52.283928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.284378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.285136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.285569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.352100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:52.363804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f3261157-b486-4f95-b25b-8824dd173a57 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090761 Jun 17 13:17:52.364527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1231/2556] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:53.098775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c8e472e7-f4e3-4324-b4d5-ed22f3014d47 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:53.099823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c8e472e7-f4e3-4324-b4d5-ed22f3014d47 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:53.107152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e472e7-f4e3-4324-b4d5-ed22f3014d47 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.107673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e472e7-f4e3-4324-b4d5-ed22f3014d47 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.108503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e472e7-f4e3-4324-b4d5-ed22f3014d47 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.108973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8e472e7-f4e3-4324-b4d5-ed22f3014d47 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.144686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c8e472e7-f4e3-4324-b4d5-ed22f3014d47 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050370 Jun 17 13:17:53.145543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1326/2557] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:53.262770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-da4cadd1-7129-4e74-aa40-01485b01c8af tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:53.264254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-da4cadd1-7129-4e74-aa40-01485b01c8af tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:53.272148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da4cadd1-7129-4e74-aa40-01485b01c8af tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.272585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da4cadd1-7129-4e74-aa40-01485b01c8af tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.273321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da4cadd1-7129-4e74-aa40-01485b01c8af tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.273768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da4cadd1-7129-4e74-aa40-01485b01c8af tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.304268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-da4cadd1-7129-4e74-aa40-01485b01c8af tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051740 Jun 17 13:17:53.304812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1232/2558] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:53.382464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:53.383038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:53.389775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.390221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.391123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.391678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.463742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:53.471898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7855a266-0524-4281-bf7c-2910dff31598 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093348 Jun 17 13:17:53.472504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1327/2559] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:54.159074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4cb0f6fe-13ee-460f-b7c7-c7dd2d804ca0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:54.160156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4cb0f6fe-13ee-460f-b7c7-c7dd2d804ca0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:54.166596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb0f6fe-13ee-460f-b7c7-c7dd2d804ca0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:54.167047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb0f6fe-13ee-460f-b7c7-c7dd2d804ca0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:54.167837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb0f6fe-13ee-460f-b7c7-c7dd2d804ca0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:54.168273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4cb0f6fe-13ee-460f-b7c7-c7dd2d804ca0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:54.199135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4cb0f6fe-13ee-460f-b7c7-c7dd2d804ca0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Jun 17 13:17:54.199631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1233/2560] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:54.318878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c65d495f-f26a-462d-9fd1-463bca6b156c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:54.319885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c65d495f-f26a-462d-9fd1-463bca6b156c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:54.326512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c65d495f-f26a-462d-9fd1-463bca6b156c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:54.326956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c65d495f-f26a-462d-9fd1-463bca6b156c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:54.327738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c65d495f-f26a-462d-9fd1-463bca6b156c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:54.328172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c65d495f-f26a-462d-9fd1-463bca6b156c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:54.355828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:54.360927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c65d495f-f26a-462d-9fd1-463bca6b156c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Jun 17 13:17:54.361502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1328/2561] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:54 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:54.491036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:54.491747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:54.501547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:54.502145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:54.502912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:54.503348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:54.568147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:54.580859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3321c901-8fc0-4bc0-86a7-99d67086253d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094601 Jun 17 13:17:54.581686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1234/2562] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:55.216100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5da288a9-cd66-45f9-a8d7-b562f412995e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:55.217586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5da288a9-cd66-45f9-a8d7-b562f412995e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:55.225793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5da288a9-cd66-45f9-a8d7-b562f412995e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.226246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5da288a9-cd66-45f9-a8d7-b562f412995e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.227002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5da288a9-cd66-45f9-a8d7-b562f412995e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.227463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5da288a9-cd66-45f9-a8d7-b562f412995e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.264738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5da288a9-cd66-45f9-a8d7-b562f412995e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055454 Jun 17 13:17:55.265355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1329/2563] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:55 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:55.375932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-250ca109-1f4e-47aa-be80-9260a62de8a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:55.377054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-250ca109-1f4e-47aa-be80-9260a62de8a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:55.383807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-250ca109-1f4e-47aa-be80-9260a62de8a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.384242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-250ca109-1f4e-47aa-be80-9260a62de8a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.384988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-250ca109-1f4e-47aa-be80-9260a62de8a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.385415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-250ca109-1f4e-47aa-be80-9260a62de8a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.416004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-250ca109-1f4e-47aa-be80-9260a62de8a5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046894 Jun 17 13:17:55.416562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1235/2564] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:55.605589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:55.606325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:55.615031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.615595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.616353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.616894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.682360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:55.690159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef1b7afd-e2e7-4446-ac00-5b1e5185d020 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090831 Jun 17 13:17:55.690706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1330/2565] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:55 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:56.282542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5b450a1-0a4f-4c9a-9807-c3c6f6eedc71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:56.284070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5b450a1-0a4f-4c9a-9807-c3c6f6eedc71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:56.295555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5b450a1-0a4f-4c9a-9807-c3c6f6eedc71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.296308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5b450a1-0a4f-4c9a-9807-c3c6f6eedc71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.297560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5b450a1-0a4f-4c9a-9807-c3c6f6eedc71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.298281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5b450a1-0a4f-4c9a-9807-c3c6f6eedc71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.303136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:56.329785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5b450a1-0a4f-4c9a-9807-c3c6f6eedc71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053923 Jun 17 13:17:56.330362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1236/2566] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:56.430022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b656a8af-6233-4d67-9474-a91ca31112f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:56.430978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b656a8af-6233-4d67-9474-a91ca31112f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:56.438424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656a8af-6233-4d67-9474-a91ca31112f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.438853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656a8af-6233-4d67-9474-a91ca31112f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.439648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656a8af-6233-4d67-9474-a91ca31112f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.440083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656a8af-6233-4d67-9474-a91ca31112f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.470507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b656a8af-6233-4d67-9474-a91ca31112f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Jun 17 13:17:56.471047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1331/2567] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:56 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:56.708526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:56.709119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:56.716587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.717024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.717873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.718372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.781674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:56.790043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd63d3f5-a4be-4454-82d8-402fa6c4fd3d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086335 Jun 17 13:17:56.790575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1237/2568] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:56 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:57.343601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c28aec85-1139-44fc-bc65-ee7f5e51f403 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:57.345066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c28aec85-1139-44fc-bc65-ee7f5e51f403 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:57.353251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c28aec85-1139-44fc-bc65-ee7f5e51f403 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.353699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c28aec85-1139-44fc-bc65-ee7f5e51f403 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.354546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c28aec85-1139-44fc-bc65-ee7f5e51f403 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.355021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c28aec85-1139-44fc-bc65-ee7f5e51f403 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.387287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c28aec85-1139-44fc-bc65-ee7f5e51f403 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048965 Jun 17 13:17:57.387878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1332/2569] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:57.484139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6edc488d-9ae4-4ac8-ac6e-2c9f3932cde9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:57.485819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6edc488d-9ae4-4ac8-ac6e-2c9f3932cde9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:57.494517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6edc488d-9ae4-4ac8-ac6e-2c9f3932cde9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.494991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6edc488d-9ae4-4ac8-ac6e-2c9f3932cde9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.496094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6edc488d-9ae4-4ac8-ac6e-2c9f3932cde9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.496656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6edc488d-9ae4-4ac8-ac6e-2c9f3932cde9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.530365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6edc488d-9ae4-4ac8-ac6e-2c9f3932cde9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051675 Jun 17 13:17:57.530924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1238/2570] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:57 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:57.808725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:57.809361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:57.816454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.816925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.817728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.818192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.887868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:57.896426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fab406c0-8ac8-4c92-95e3-3a0b9e358048 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092456 Jun 17 13:17:57.896993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1333/2571] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:57 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:58.400470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-360593ec-493d-42cc-86bb-d7d44f603d0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:58.401442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-360593ec-493d-42cc-86bb-d7d44f603d0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:58.408014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-360593ec-493d-42cc-86bb-d7d44f603d0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.408495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-360593ec-493d-42cc-86bb-d7d44f603d0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.409270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-360593ec-493d-42cc-86bb-d7d44f603d0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.409703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-360593ec-493d-42cc-86bb-d7d44f603d0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.445073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-360593ec-493d-42cc-86bb-d7d44f603d0b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050326 Jun 17 13:17:58.445642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1239/2572] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:58.542587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e02ac44f-249a-43d9-8a45-601feaccddc3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:58.543572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e02ac44f-249a-43d9-8a45-601feaccddc3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:58.550690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e02ac44f-249a-43d9-8a45-601feaccddc3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.551135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e02ac44f-249a-43d9-8a45-601feaccddc3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.551942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e02ac44f-249a-43d9-8a45-601feaccddc3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.552372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e02ac44f-249a-43d9-8a45-601feaccddc3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.583994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e02ac44f-249a-43d9-8a45-601feaccddc3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Jun 17 13:17:58.584598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1334/2573] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:58 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:58.914364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:58.914995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:58.921970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.922416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.923176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.923649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.986443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:17:58.995226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7977ae4c-ebf9-498a-9f41-fc50fca95209 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084777 Jun 17 13:17:58.996637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1240/2574] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:17:58 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:17:59.464324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5b1b7e05-50e5-4f7e-8b00-bf2ce90200c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:59.466001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5b1b7e05-50e5-4f7e-8b00-bf2ce90200c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:59.473000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b1b7e05-50e5-4f7e-8b00-bf2ce90200c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.473559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b1b7e05-50e5-4f7e-8b00-bf2ce90200c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.474347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b1b7e05-50e5-4f7e-8b00-bf2ce90200c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.474785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b1b7e05-50e5-4f7e-8b00-bf2ce90200c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.506280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5b1b7e05-50e5-4f7e-8b00-bf2ce90200c2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048175 Jun 17 13:17:59.506902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1335/2575] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:59.596462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-438ed545-af34-4744-8ec7-3c80ff2035df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:59.597385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-438ed545-af34-4744-8ec7-3c80ff2035df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:59.604107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-438ed545-af34-4744-8ec7-3c80ff2035df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.604839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-438ed545-af34-4744-8ec7-3c80ff2035df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.605724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-438ed545-af34-4744-8ec7-3c80ff2035df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.606161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-438ed545-af34-4744-8ec7-3c80ff2035df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.637226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-438ed545-af34-4744-8ec7-3c80ff2035df tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Jun 17 13:17:59.637780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1241/2576] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:59 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:00.012920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:00.013531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:00.020591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.021035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.021796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.022227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.084033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:00.092260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ba3d51d0-702b-46d9-a48d-59e1df5cfc66 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.083444 Jun 17 13:18:00.092830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1336/2577] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:00 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:00.520037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad0525c5-3a43-4ffc-a717-75309d046897 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:00.521061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad0525c5-3a43-4ffc-a717-75309d046897 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:00.529610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad0525c5-3a43-4ffc-a717-75309d046897 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.530197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad0525c5-3a43-4ffc-a717-75309d046897 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.531092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad0525c5-3a43-4ffc-a717-75309d046897 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.531692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad0525c5-3a43-4ffc-a717-75309d046897 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.563518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad0525c5-3a43-4ffc-a717-75309d046897 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048512 Jun 17 13:18:00.564097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1242/2578] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:00.654165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f4468b8d-70c5-48bb-bc3d-5996db4eeead tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:00.655675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f4468b8d-70c5-48bb-bc3d-5996db4eeead tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:00.665968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4468b8d-70c5-48bb-bc3d-5996db4eeead tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.666695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4468b8d-70c5-48bb-bc3d-5996db4eeead tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.667934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4468b8d-70c5-48bb-bc3d-5996db4eeead tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.669035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4468b8d-70c5-48bb-bc3d-5996db4eeead tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.699304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f4468b8d-70c5-48bb-bc3d-5996db4eeead tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052618 Jun 17 13:18:00.700089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1337/2579] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:01.113586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:01.114591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:01.124489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.124935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.125734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.126168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.201367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:01.209521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8721d261-f05e-4937-a13f-7f656f108c79 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.102535 Jun 17 13:18:01.210779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1243/2580] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:01 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:01.579333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0ba35d41-af34-45b1-98c6-dc303fa535ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:18:01.580497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0ba35d41-af34-45b1-98c6-dc303fa535ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:01.588269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ba35d41-af34-45b1-98c6-dc303fa535ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.588764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ba35d41-af34-45b1-98c6-dc303fa535ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.589636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ba35d41-af34-45b1-98c6-dc303fa535ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.590114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ba35d41-af34-45b1-98c6-dc303fa535ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.680754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0ba35d41-af34-45b1-98c6-dc303fa535ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/action" status: 200 len: 118893 microversion: 2.1 time: 0.106871 Jun 17 13:18:01.681654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1338/2581] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 13:18:01 2022] POST /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898/action => generated 118893 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:18:01.714573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-63f33513-b7a0-4422-8f04-c3ba5a1da5f9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:01.715586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-63f33513-b7a0-4422-8f04-c3ba5a1da5f9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:01.726633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f33513-b7a0-4422-8f04-c3ba5a1da5f9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.727071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f33513-b7a0-4422-8f04-c3ba5a1da5f9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.727850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f33513-b7a0-4422-8f04-c3ba5a1da5f9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.728272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f33513-b7a0-4422-8f04-c3ba5a1da5f9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.764332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-63f33513-b7a0-4422-8f04-c3ba5a1da5f9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056671 Jun 17 13:18:01.764916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1244/2582] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:02.233485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:02.234264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:02.243199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.243807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.244730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.245259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.309497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:02.318226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-631bf5e4-85d8-419a-988f-6cd985f37102 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.090094 Jun 17 13:18:02.318812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1339/2583] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:02 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:02.776831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-11916ad9-bb8f-4ff6-9d95-ccaa6794e763 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:02.777995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-11916ad9-bb8f-4ff6-9d95-ccaa6794e763 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:02.786578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11916ad9-bb8f-4ff6-9d95-ccaa6794e763 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.787208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11916ad9-bb8f-4ff6-9d95-ccaa6794e763 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.788187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11916ad9-bb8f-4ff6-9d95-ccaa6794e763 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.788707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11916ad9-bb8f-4ff6-9d95-ccaa6794e763 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.820803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-11916ad9-bb8f-4ff6-9d95-ccaa6794e763 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048348 Jun 17 13:18:02.821332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1245/2584] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:03.336090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:03.336752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:03.339290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=80 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:03.346125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.346559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.347318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.347785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.414385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:03.424556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c1dfcbae-783b-4e83-8c19-fc6fb2d6340b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092487 Jun 17 13:18:03.425161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1340/2585] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:03 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:03.832957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-56c76c4f-0116-4f74-8cd2-ad3b2f6bea79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:03.833886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-56c76c4f-0116-4f74-8cd2-ad3b2f6bea79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:03.841077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56c76c4f-0116-4f74-8cd2-ad3b2f6bea79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.841525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56c76c4f-0116-4f74-8cd2-ad3b2f6bea79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.842307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56c76c4f-0116-4f74-8cd2-ad3b2f6bea79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.842726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56c76c4f-0116-4f74-8cd2-ad3b2f6bea79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.873772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-56c76c4f-0116-4f74-8cd2-ad3b2f6bea79 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Jun 17 13:18:03.874362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1246/2586] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:04.442254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:04.442814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:04.449895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.450333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.451116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.451584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.518813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:04.526704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b6415fc7-db67-46b6-af52-2ad4acf40c4d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088461 Jun 17 13:18:04.527315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1341/2587] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:04 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:04.886050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2394172e-a483-4934-aae4-fa3239b89a8c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:04.887000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2394172e-a483-4934-aae4-fa3239b89a8c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:04.894655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2394172e-a483-4934-aae4-fa3239b89a8c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.895095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2394172e-a483-4934-aae4-fa3239b89a8c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.895886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2394172e-a483-4934-aae4-fa3239b89a8c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.896309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2394172e-a483-4934-aae4-fa3239b89a8c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.927018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2394172e-a483-4934-aae4-fa3239b89a8c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Jun 17 13:18:04.927611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1247/2588] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:05.544799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:05.545443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:05.552475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.552923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.553689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.554124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.616961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:05.625796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-53affa47-1139-43cb-ba81-e8d724d909a9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.085086 Jun 17 13:18:05.626463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1342/2589] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:05 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:05.939462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4946e86b-9164-4f51-a461-f0c80ad67b50 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:05.940316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4946e86b-9164-4f51-a461-f0c80ad67b50 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:05.947398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4946e86b-9164-4f51-a461-f0c80ad67b50 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.947886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4946e86b-9164-4f51-a461-f0c80ad67b50 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.948647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4946e86b-9164-4f51-a461-f0c80ad67b50 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.949080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4946e86b-9164-4f51-a461-f0c80ad67b50 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.980042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4946e86b-9164-4f51-a461-f0c80ad67b50 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Jun 17 13:18:05.980605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1248/2590] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:06.642484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:06.643105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:06.649552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.650000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.650763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.651189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.712849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:06.720921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6f889170-e382-4565-b1b7-7e0433865b88 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.082488 Jun 17 13:18:06.721502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1343/2591] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:06 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:06.994342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-be770d5c-aeda-4c46-a7cb-f02d2c67cc7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:06.995324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-be770d5c-aeda-4c46-a7cb-f02d2c67cc7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:07.002178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be770d5c-aeda-4c46-a7cb-f02d2c67cc7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.002634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be770d5c-aeda-4c46-a7cb-f02d2c67cc7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.003413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be770d5c-aeda-4c46-a7cb-f02d2c67cc7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.003859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-be770d5c-aeda-4c46-a7cb-f02d2c67cc7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.033482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-be770d5c-aeda-4c46-a7cb-f02d2c67cc7d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Jun 17 13:18:07.034033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1249/2592] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:07.738315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:07.739022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:07.746011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.746463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.747231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.747699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.811015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:07.818968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e3aa908e-c660-4a6f-848a-aeffdcea805f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.084640 Jun 17 13:18:07.819560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1344/2593] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:07 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:08.045876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1ee37d2f-5f74-4e32-b48e-7a682fc4d588 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:08.046832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1ee37d2f-5f74-4e32-b48e-7a682fc4d588 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:08.053799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ee37d2f-5f74-4e32-b48e-7a682fc4d588 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.054242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ee37d2f-5f74-4e32-b48e-7a682fc4d588 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.054992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ee37d2f-5f74-4e32-b48e-7a682fc4d588 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.055419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ee37d2f-5f74-4e32-b48e-7a682fc4d588 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.086354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1ee37d2f-5f74-4e32-b48e-7a682fc4d588 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Jun 17 13:18:08.086881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1250/2594] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:08.836980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:08.837707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:08.844772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.845217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.845983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.846415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.910939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:08.914410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:08.919610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-10d4cdfa-4b06-4f08-9856-816a1a237964 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086396 Jun 17 13:18:08.920179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1345/2595] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:08 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:09.098509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-84d90423-a360-4454-8b4c-e1bfef7d1ec0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:09.099331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-84d90423-a360-4454-8b4c-e1bfef7d1ec0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:09.106454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84d90423-a360-4454-8b4c-e1bfef7d1ec0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.107081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84d90423-a360-4454-8b4c-e1bfef7d1ec0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.107877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84d90423-a360-4454-8b4c-e1bfef7d1ec0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.108308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84d90423-a360-4454-8b4c-e1bfef7d1ec0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.139991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-84d90423-a360-4454-8b4c-e1bfef7d1ec0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Jun 17 13:18:09.140541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1251/2596] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:09.937458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:09.938062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:09.954436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.954595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.955794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.955794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.025223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:10.033501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b6bd1aa-7707-46f9-bb72-75cb11256be7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100448 Jun 17 13:18:10.034074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1346/2597] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:09 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:10.151849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e375615-c09e-4801-bb2d-b8f9ad76dc6f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:10.152747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e375615-c09e-4801-bb2d-b8f9ad76dc6f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:10.159847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e375615-c09e-4801-bb2d-b8f9ad76dc6f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.160290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e375615-c09e-4801-bb2d-b8f9ad76dc6f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.161053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e375615-c09e-4801-bb2d-b8f9ad76dc6f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.161475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e375615-c09e-4801-bb2d-b8f9ad76dc6f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.187401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:10.192527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e375615-c09e-4801-bb2d-b8f9ad76dc6f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Jun 17 13:18:10.193011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1252/2598] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:11.050629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:11.051289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:11.058146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.058588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.059839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.059987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.124629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:11.132729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-57699437-d705-43c8-b13a-84590befde35 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086071 Jun 17 13:18:11.133292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1347/2599] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:11 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:11.204942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-265eb1ae-01d4-4e90-9738-d43a6b940a6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:11.205857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-265eb1ae-01d4-4e90-9738-d43a6b940a6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:11.208617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=78 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:11.214551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-265eb1ae-01d4-4e90-9738-d43a6b940a6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.214994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-265eb1ae-01d4-4e90-9738-d43a6b940a6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.216160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-265eb1ae-01d4-4e90-9738-d43a6b940a6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.216671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-265eb1ae-01d4-4e90-9738-d43a6b940a6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.247592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-265eb1ae-01d4-4e90-9738-d43a6b940a6e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046361 Jun 17 13:18:11.248547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1253/2600] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:12.150241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:12.150858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:12.157988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:12.158442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:12.159205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:12.159666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:12.223790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:12.232567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe30915b-94fa-4958-923e-0e23b7f9a486 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086138 Jun 17 13:18:12.233139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1348/2601] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:12 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:12.260245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-57638a90-1584-4f67-a05b-2271be50063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:12.261161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-57638a90-1584-4f67-a05b-2271be50063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:12.268629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57638a90-1584-4f67-a05b-2271be50063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:12.269101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57638a90-1584-4f67-a05b-2271be50063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:12.269857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57638a90-1584-4f67-a05b-2271be50063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:12.270288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-57638a90-1584-4f67-a05b-2271be50063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:12.302832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-57638a90-1584-4f67-a05b-2271be50063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046644 Jun 17 13:18:12.303483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1254/2602] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:13.250411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:13.250994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:13.258252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.258708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.259508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.259938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.317216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc65b2f9-bc17-4c61-877c-a7608e55329a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:13.318143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc65b2f9-bc17-4c61-877c-a7608e55329a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:13.324731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:13.326564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc65b2f9-bc17-4c61-877c-a7608e55329a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.327152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc65b2f9-bc17-4c61-877c-a7608e55329a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.328259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc65b2f9-bc17-4c61-877c-a7608e55329a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.328870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc65b2f9-bc17-4c61-877c-a7608e55329a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.332880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-626ef170-c866-4b4d-b3fe-51bfa42781e1 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086905 Jun 17 13:18:13.335424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1349/2603] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:13 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:13.370040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc65b2f9-bc17-4c61-877c-a7608e55329a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056776 Jun 17 13:18:13.370508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1255/2604] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:18:14.359166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:14.359793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:14.366867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.367306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.368096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.368529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.382328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a9779a03-89a6-499e-a117-41e83427229f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:14.383280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a9779a03-89a6-499e-a117-41e83427229f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:14.390251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9779a03-89a6-499e-a117-41e83427229f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.390696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9779a03-89a6-499e-a117-41e83427229f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.391500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9779a03-89a6-499e-a117-41e83427229f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.391936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9779a03-89a6-499e-a117-41e83427229f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.424076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a9779a03-89a6-499e-a117-41e83427229f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045700 Jun 17 13:18:14.424661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1256/2605] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:14.433258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:14.441518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-50752688-f49b-4081-8f41-705011c33091 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086378 Jun 17 13:18:14.442073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1350/2606] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:14 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:15.438025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4963a912-95e2-4c44-9363-aaf33bc36f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:15.438843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4963a912-95e2-4c44-9363-aaf33bc36f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:15.445812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4963a912-95e2-4c44-9363-aaf33bc36f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.446246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4963a912-95e2-4c44-9363-aaf33bc36f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.446996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4963a912-95e2-4c44-9363-aaf33bc36f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.447409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4963a912-95e2-4c44-9363-aaf33bc36f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.458135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:15.458729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:15.466180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.466683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.467474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.467901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.481089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4963a912-95e2-4c44-9363-aaf33bc36f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047437 Jun 17 13:18:15.481609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1257/2607] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:15.537202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:15.545536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0b571484-c2b5-4803-aadf-2a7d92ed9da9 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.091218 Jun 17 13:18:15.546090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1351/2608] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:15 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:16.493483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4b5d9ded-f582-4bc4-95e7-871b7f323c1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:16.494415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4b5d9ded-f582-4bc4-95e7-871b7f323c1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:16.502198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b5d9ded-f582-4bc4-95e7-871b7f323c1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.502635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b5d9ded-f582-4bc4-95e7-871b7f323c1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.503405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b5d9ded-f582-4bc4-95e7-871b7f323c1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.503879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b5d9ded-f582-4bc4-95e7-871b7f323c1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.535774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4b5d9ded-f582-4bc4-95e7-871b7f323c1b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046191 Jun 17 13:18:16.536359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1258/2609] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:16.562395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:16.563000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:16.570029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.570470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.571230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.571693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.642783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:16.651322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c35ccf51-db9d-4ea3-82b7-3ad26f91aac8 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092907 Jun 17 13:18:16.651924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1352/2610] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:16 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:17.548425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bdf932ab-ac3c-4a85-9222-ccbdf6fd16fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:17.549342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bdf932ab-ac3c-4a85-9222-ccbdf6fd16fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:17.556031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf932ab-ac3c-4a85-9222-ccbdf6fd16fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.556465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf932ab-ac3c-4a85-9222-ccbdf6fd16fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.557214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf932ab-ac3c-4a85-9222-ccbdf6fd16fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.557643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdf932ab-ac3c-4a85-9222-ccbdf6fd16fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.586912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bdf932ab-ac3c-4a85-9222-ccbdf6fd16fb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Jun 17 13:18:17.587475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1259/2611] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:17.671817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:17.672458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:17.680089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.680533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.681291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.681718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.755933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:17.764612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e18bfe62-51cd-4163-bff5-79d9ae631e5f tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097991 Jun 17 13:18:17.765176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1353/2612] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:17 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:18.602777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e06f0ab1-9256-4861-9794-fe08aaec193b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:18.604305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e06f0ab1-9256-4861-9794-fe08aaec193b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:18.615519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e06f0ab1-9256-4861-9794-fe08aaec193b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.616168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e06f0ab1-9256-4861-9794-fe08aaec193b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.617419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e06f0ab1-9256-4861-9794-fe08aaec193b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.618130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e06f0ab1-9256-4861-9794-fe08aaec193b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.649756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e06f0ab1-9256-4861-9794-fe08aaec193b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053874 Jun 17 13:18:18.650301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1260/2613] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:18.783004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:18.783656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:18.791060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.791564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.792330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.792764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.862030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:18.875409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-62bd25d4-b029-4af7-8670-1fb8cf55e015 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096128 Jun 17 13:18:18.876173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1354/2614] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:18 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:19.665907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a870379-ff1e-4683-bcbd-fb35b5aa1955 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:19.667441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a870379-ff1e-4683-bcbd-fb35b5aa1955 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:19.675354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a870379-ff1e-4683-bcbd-fb35b5aa1955 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.675836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a870379-ff1e-4683-bcbd-fb35b5aa1955 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.676608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a870379-ff1e-4683-bcbd-fb35b5aa1955 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.677033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a870379-ff1e-4683-bcbd-fb35b5aa1955 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.707041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a870379-ff1e-4683-bcbd-fb35b5aa1955 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047888 Jun 17 13:18:19.707643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1261/2615] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:19.897795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:19.899035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:19.909983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.910699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.912014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.912741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.978584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:19.986684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-32674333-2ddb-414e-a7c6-e726718064a4 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095392 Jun 17 13:18:19.987248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1355/2616] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:19 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:20.365606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:18:20.365913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:18:20.719744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8f093dda-0828-4827-a1f3-3592c9e2279e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:20.720602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8f093dda-0828-4827-a1f3-3592c9e2279e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:20.728056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f093dda-0828-4827-a1f3-3592c9e2279e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:20.728494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f093dda-0828-4827-a1f3-3592c9e2279e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:20.729220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f093dda-0828-4827-a1f3-3592c9e2279e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:20.729674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f093dda-0828-4827-a1f3-3592c9e2279e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:20.766654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8f093dda-0828-4827-a1f3-3592c9e2279e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051733 Jun 17 13:18:20.767237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1262/2617] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:21.007868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:21.008487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:21.018178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.018626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.019612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.020115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.089019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:21.106800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-72b365fe-accb-4bb2-b0a3-c2fdcd211575 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.104328 Jun 17 13:18:21.108004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1356/2618] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:21 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:21.778977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-78689340-28eb-4690-8c03-2debe04e3138 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:21.780195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-78689340-28eb-4690-8c03-2debe04e3138 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:21.787414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78689340-28eb-4690-8c03-2debe04e3138 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.787855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78689340-28eb-4690-8c03-2debe04e3138 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.788622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78689340-28eb-4690-8c03-2debe04e3138 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.789052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78689340-28eb-4690-8c03-2debe04e3138 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.820604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-78689340-28eb-4690-8c03-2debe04e3138 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Jun 17 13:18:21.821175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1263/2619] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:22.129029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:22.129878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:22.140242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.140689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.141451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.141920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.211120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:22.218985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9cd6eba8-85be-4462-9023-e59320efc686 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096950 Jun 17 13:18:22.219589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1357/2620] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:22 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:22.834632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-643ad374-79cc-443d-9108-22792164542b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:22.835679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-643ad374-79cc-443d-9108-22792164542b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:22.843340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-643ad374-79cc-443d-9108-22792164542b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.843864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-643ad374-79cc-443d-9108-22792164542b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.844952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-643ad374-79cc-443d-9108-22792164542b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.845443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-643ad374-79cc-443d-9108-22792164542b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.878231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-643ad374-79cc-443d-9108-22792164542b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048165 Jun 17 13:18:22.878853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1264/2621] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:23.239203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:23.239861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:23.247079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.247588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.248747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.249200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.320468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:23.331767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-221ee1f4-3dc2-411a-9a71-47f75c0bb34a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097423 Jun 17 13:18:23.332336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1358/2622] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:23 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:23.896070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff386597-5a00-4c7b-bbb0-4bc7ec08d4c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:23.897954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff386597-5a00-4c7b-bbb0-4bc7ec08d4c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:23.909668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff386597-5a00-4c7b-bbb0-4bc7ec08d4c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.910112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff386597-5a00-4c7b-bbb0-4bc7ec08d4c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.910873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff386597-5a00-4c7b-bbb0-4bc7ec08d4c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.911306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff386597-5a00-4c7b-bbb0-4bc7ec08d4c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.942054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff386597-5a00-4c7b-bbb0-4bc7ec08d4c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053964 Jun 17 13:18:23.942525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1265/2623] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:24.046639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:18:24.047054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:18:24.349598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:24.350370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:24.357437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.357882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:24.358640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.359065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:24.424220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:24.431994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-794d0e6d-c2f6-4d89-ac3e-e89c536a0627 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.086746 Jun 17 13:18:24.432557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1359/2624] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:24 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:24.959186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f26ac138-7cc0-46d5-8dc2-e59bc78e8395 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:24.960390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f26ac138-7cc0-46d5-8dc2-e59bc78e8395 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:24.968825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f26ac138-7cc0-46d5-8dc2-e59bc78e8395 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.969375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f26ac138-7cc0-46d5-8dc2-e59bc78e8395 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:24.970294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f26ac138-7cc0-46d5-8dc2-e59bc78e8395 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.970835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f26ac138-7cc0-46d5-8dc2-e59bc78e8395 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:25.004622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f26ac138-7cc0-46d5-8dc2-e59bc78e8395 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051759 Jun 17 13:18:25.005157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1266/2625] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:25.453838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:25.455069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:25.462702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:25.463149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:25.463938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:25.464365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:25.530888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:25.539123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c459c95-c5df-496e-92fe-73867279d1fb tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.092652 Jun 17 13:18:25.539715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1360/2626] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:25 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:26.019849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-36104541-e71f-4754-a6da-053ab5642db8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:26.020993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-36104541-e71f-4754-a6da-053ab5642db8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:26.031159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36104541-e71f-4754-a6da-053ab5642db8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.031803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36104541-e71f-4754-a6da-053ab5642db8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.032790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36104541-e71f-4754-a6da-053ab5642db8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.033350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36104541-e71f-4754-a6da-053ab5642db8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.063846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-36104541-e71f-4754-a6da-053ab5642db8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050266 Jun 17 13:18:26.064391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1267/2627] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:26.560874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:26.561860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:26.572084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.572506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.573312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.573725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.648943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:26.656894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6aecce20-0d5d-4d17-a53e-fb797fc72ae2 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.102748 Jun 17 13:18:26.657466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1361/2628] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:26 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:27.077042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02b63434-c92e-435d-bc0c-74e8a132c14e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:27.078087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02b63434-c92e-435d-bc0c-74e8a132c14e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:27.085471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b63434-c92e-435d-bc0c-74e8a132c14e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.085999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b63434-c92e-435d-bc0c-74e8a132c14e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.086756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b63434-c92e-435d-bc0c-74e8a132c14e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.087191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b63434-c92e-435d-bc0c-74e8a132c14e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.118824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02b63434-c92e-435d-bc0c-74e8a132c14e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Jun 17 13:18:27.119398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1268/2629] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:27.676622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:27.677418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:27.684989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.685439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.686195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.686628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.711589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:27.757390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:27.765390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4802bc67-5000-4ffa-a8ea-2d227d07d84b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.094134 Jun 17 13:18:27.765953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1362/2630] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:27 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:28.135414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c842d513-7713-4925-a3f1-61d6e37a263c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:28.136375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c842d513-7713-4925-a3f1-61d6e37a263c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:28.143361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c842d513-7713-4925-a3f1-61d6e37a263c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.143840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c842d513-7713-4925-a3f1-61d6e37a263c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.144587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c842d513-7713-4925-a3f1-61d6e37a263c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.145014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c842d513-7713-4925-a3f1-61d6e37a263c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.161782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:28.176197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c842d513-7713-4925-a3f1-61d6e37a263c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048090 Jun 17 13:18:28.176785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1269/2631] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:28.786780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:28.787791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:28.799220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.800005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.801238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.801953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.867705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:28.876340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-da105503-5273-4144-9192-bc0dfc15fbe5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096136 Jun 17 13:18:28.876903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1363/2632] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:28 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:29.192714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-207b1d44-eb62-4da6-b524-abe048831f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:29.194270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-207b1d44-eb62-4da6-b524-abe048831f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:29.202796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207b1d44-eb62-4da6-b524-abe048831f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.203319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207b1d44-eb62-4da6-b524-abe048831f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:29.204123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207b1d44-eb62-4da6-b524-abe048831f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.204558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207b1d44-eb62-4da6-b524-abe048831f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:29.233751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-207b1d44-eb62-4da6-b524-abe048831f97 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047694 Jun 17 13:18:29.234300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1270/2633] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:29.898781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:29.899427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:29.910285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.910916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:29.912129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.912740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:29.976648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:29.987174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b40f9d3-91bc-4449-bc64-d7947118fe4a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096890 Jun 17 13:18:29.987766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1364/2634] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:29 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:30.250258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47f0d0cb-eb18-440c-b4da-a7b1f97f53d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:30.251802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47f0d0cb-eb18-440c-b4da-a7b1f97f53d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:30.262925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47f0d0cb-eb18-440c-b4da-a7b1f97f53d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:30.263722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47f0d0cb-eb18-440c-b4da-a7b1f97f53d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:30.264975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47f0d0cb-eb18-440c-b4da-a7b1f97f53d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:30.265689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47f0d0cb-eb18-440c-b4da-a7b1f97f53d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:30.300042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47f0d0cb-eb18-440c-b4da-a7b1f97f53d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056981 Jun 17 13:18:30.300605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1271/2635] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:30 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:31.014476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:31.015489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:31.026614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.027043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.027847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.028281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.095235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:31.103013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98de99fb-883b-43c8-b671-946c75a09651 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095429 Jun 17 13:18:31.103619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1365/2636] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:31 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:31.316180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-88dcd76f-868c-42fc-bf96-49cb29c2ca17 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:31.317555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-88dcd76f-868c-42fc-bf96-49cb29c2ca17 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:31.326666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88dcd76f-868c-42fc-bf96-49cb29c2ca17 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.327109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88dcd76f-868c-42fc-bf96-49cb29c2ca17 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.327913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88dcd76f-868c-42fc-bf96-49cb29c2ca17 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.328350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88dcd76f-868c-42fc-bf96-49cb29c2ca17 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.357788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-88dcd76f-868c-42fc-bf96-49cb29c2ca17 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048397 Jun 17 13:18:31.358348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1272/2637] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:32.122299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:32.123526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:32.131900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.132547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.133388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.133806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.209966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:32.218196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a26294d8-69b1-4c8c-b6dd-b004c2f65396 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.101517 Jun 17 13:18:32.218693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1366/2638] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:32 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:32.374525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5b3213d0-51a8-46a9-82b8-35cc2f5e7300 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:32.375496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5b3213d0-51a8-46a9-82b8-35cc2f5e7300 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:32.382364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b3213d0-51a8-46a9-82b8-35cc2f5e7300 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.382819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b3213d0-51a8-46a9-82b8-35cc2f5e7300 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.383614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b3213d0-51a8-46a9-82b8-35cc2f5e7300 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.384049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5b3213d0-51a8-46a9-82b8-35cc2f5e7300 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.414940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5b3213d0-51a8-46a9-82b8-35cc2f5e7300 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Jun 17 13:18:32.415542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1273/2639] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:33.240223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:33.241148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:33.252716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.253359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.254527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.255145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.324820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:33.334278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-090f4596-c327-4d6b-a460-63a2a3aee400 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100710 Jun 17 13:18:33.334953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1367/2640] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:33 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:33.429931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-66767a34-4623-4253-ac14-3cb8a4672367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:33.432240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-66767a34-4623-4253-ac14-3cb8a4672367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:33.441634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66767a34-4623-4253-ac14-3cb8a4672367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.442096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66767a34-4623-4253-ac14-3cb8a4672367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.442854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66767a34-4623-4253-ac14-3cb8a4672367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.443283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-66767a34-4623-4253-ac14-3cb8a4672367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.473245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-66767a34-4623-4253-ac14-3cb8a4672367 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049688 Jun 17 13:18:33.474042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1274/2641] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:34.357812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:34.358528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:34.361154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=56 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:34.367266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.367765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.368680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.369114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.446155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:34.454379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2da3801-abfe-479c-992d-77bdfe28f245 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.104310 Jun 17 13:18:34.454985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1368/2642] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:34 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:34.485376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d4da000b-9ef7-4205-85a8-a8e843f17d19 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:34.486304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d4da000b-9ef7-4205-85a8-a8e843f17d19 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:34.493194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4da000b-9ef7-4205-85a8-a8e843f17d19 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.493654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4da000b-9ef7-4205-85a8-a8e843f17d19 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.494414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4da000b-9ef7-4205-85a8-a8e843f17d19 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.494850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4da000b-9ef7-4205-85a8-a8e843f17d19 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.529078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d4da000b-9ef7-4205-85a8-a8e843f17d19 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047536 Jun 17 13:18:34.529951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1275/2643] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:35.475753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:35.476574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:35.486803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.487619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.488772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.489431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.543923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2b93c88b-228b-4ed1-9a3d-6144612ddbf9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:35.545360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2b93c88b-228b-4ed1-9a3d-6144612ddbf9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:35.556297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b93c88b-228b-4ed1-9a3d-6144612ddbf9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.556866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b93c88b-228b-4ed1-9a3d-6144612ddbf9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.558039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b93c88b-228b-4ed1-9a3d-6144612ddbf9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.559399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b93c88b-228b-4ed1-9a3d-6144612ddbf9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.566405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:35.574444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f17cd1c-3b83-4dc9-80cf-881afe4290e7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.105007 Jun 17 13:18:35.574995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1369/2644] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:35 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:35.591293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2b93c88b-228b-4ed1-9a3d-6144612ddbf9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053463 Jun 17 13:18:35.591938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1276/2645] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:36.596205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:36.597160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:36.606495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8e2c4a67-edab-48a2-a304-fde1fb7dbbe2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:36.607417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.607974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8e2c4a67-edab-48a2-a304-fde1fb7dbbe2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:36.608357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.609120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.609603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.614695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e2c4a67-edab-48a2-a304-fde1fb7dbbe2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.615149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e2c4a67-edab-48a2-a304-fde1fb7dbbe2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.615946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e2c4a67-edab-48a2-a304-fde1fb7dbbe2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.616386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e2c4a67-edab-48a2-a304-fde1fb7dbbe2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.646764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8e2c4a67-edab-48a2-a304-fde1fb7dbbe2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Jun 17 13:18:36.647724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1277/2646] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:36.685654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:36.697216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-305b1343-8e22-4698-ae70-6a5b45f3ce22 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.107627 Jun 17 13:18:36.697987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1370/2647] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:36 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:37.664355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ea6d76c9-ba9a-4f1f-8c41-5cf15861d514 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:37.665682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ea6d76c9-ba9a-4f1f-8c41-5cf15861d514 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:37.675676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea6d76c9-ba9a-4f1f-8c41-5cf15861d514 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.676318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea6d76c9-ba9a-4f1f-8c41-5cf15861d514 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.677414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea6d76c9-ba9a-4f1f-8c41-5cf15861d514 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.678032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea6d76c9-ba9a-4f1f-8c41-5cf15861d514 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.710082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ea6d76c9-ba9a-4f1f-8c41-5cf15861d514 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051776 Jun 17 13:18:37.710831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1278/2648] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:37.715020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:37.715772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:37.723394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.723891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.724658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.725097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.797256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:37.805415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-427ad9df-b339-4223-88d2-483d32a14475 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095026 Jun 17 13:18:37.805984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1371/2649] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:37 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:18:38.726199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-05306bb9-a3a7-48bc-9908-ade48f5080a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:38.727298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-05306bb9-a3a7-48bc-9908-ade48f5080a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:38.736687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05306bb9-a3a7-48bc-9908-ade48f5080a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.737128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05306bb9-a3a7-48bc-9908-ade48f5080a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.737886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05306bb9-a3a7-48bc-9908-ade48f5080a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.738302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05306bb9-a3a7-48bc-9908-ade48f5080a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.769895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-05306bb9-a3a7-48bc-9908-ade48f5080a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050706 Jun 17 13:18:38.770452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1279/2650] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:38.825053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:38.825635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:38.835612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.836235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.837409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.838079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.910899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:38.923196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9292017e-d83b-4cbc-827e-7388a758e38a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.102324 Jun 17 13:18:38.923796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1372/2651] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:38 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:39.782353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-051cd2ae-25d2-4a36-a160-c108c3e9d8fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:39.783287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-051cd2ae-25d2-4a36-a160-c108c3e9d8fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:39.790477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051cd2ae-25d2-4a36-a160-c108c3e9d8fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.790931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051cd2ae-25d2-4a36-a160-c108c3e9d8fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:39.791746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051cd2ae-25d2-4a36-a160-c108c3e9d8fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.792181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-051cd2ae-25d2-4a36-a160-c108c3e9d8fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:39.822603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-051cd2ae-25d2-4a36-a160-c108c3e9d8fc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Jun 17 13:18:39.823202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1280/2652] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:39.944524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:39.945554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:39.956914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.957642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:39.958877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.959629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:40.029150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:40.038253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-05b1c951-663f-4d33-b2f1-abe9dda67383 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.100670 Jun 17 13:18:40.038725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1373/2653] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:39 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:40.419825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:18:40.419825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:18:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:18:40.838979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2df8e130-e7d7-40ae-a186-1fe1d3f9c68e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:40.840518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2df8e130-e7d7-40ae-a186-1fe1d3f9c68e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:40.848956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2df8e130-e7d7-40ae-a186-1fe1d3f9c68e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:40.849404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2df8e130-e7d7-40ae-a186-1fe1d3f9c68e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:40.850171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2df8e130-e7d7-40ae-a186-1fe1d3f9c68e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:40.850605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2df8e130-e7d7-40ae-a186-1fe1d3f9c68e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:40.881240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2df8e130-e7d7-40ae-a186-1fe1d3f9c68e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049026 Jun 17 13:18:40.881794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1281/2654] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:41.066302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:41.067210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:41.078623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.079068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.079852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.080288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.151234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:41.159622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3941c03b-5614-4f68-adb3-d7f5f9355c2d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098424 Jun 17 13:18:41.160192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1374/2655] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:41 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:41.898162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2fe209f5-86e2-464b-a7fb-7d4914b1f884 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:41.899413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2fe209f5-86e2-464b-a7fb-7d4914b1f884 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:41.902374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=58 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:41.910188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fe209f5-86e2-464b-a7fb-7d4914b1f884 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.910770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fe209f5-86e2-464b-a7fb-7d4914b1f884 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.911803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fe209f5-86e2-464b-a7fb-7d4914b1f884 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.912364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2fe209f5-86e2-464b-a7fb-7d4914b1f884 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.944557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2fe209f5-86e2-464b-a7fb-7d4914b1f884 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052713 Jun 17 13:18:41.945089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1282/2656] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:42.181455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:42.182302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:42.192079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.192528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:42.193288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.193717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:42.264175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:42.272323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f3da3a84-591d-496c-ac7a-cffd5baeca29 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097754 Jun 17 13:18:42.272892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1375/2657] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:42 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:42.960862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cc99612e-7878-4979-ab34-91da0399034f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:42.962333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cc99612e-7878-4979-ab34-91da0399034f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:42.972910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc99612e-7878-4979-ab34-91da0399034f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.973320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc99612e-7878-4979-ab34-91da0399034f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:42.974137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc99612e-7878-4979-ab34-91da0399034f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.974568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc99612e-7878-4979-ab34-91da0399034f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:43.003862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cc99612e-7878-4979-ab34-91da0399034f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049961 Jun 17 13:18:43.004426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1283/2658] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:43.293491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:43.294582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:43.303885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:43.304324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:43.305441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:43.305874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:43.370500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:43.383450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e8063cff-355f-4221-9704-6f3f8bc6e480 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.096244 Jun 17 13:18:43.384253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1376/2659] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:43 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:44.019067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3710025e-42b1-4461-b07b-7b1536d6c0c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:44.020040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3710025e-42b1-4461-b07b-7b1536d6c0c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:44.027001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3710025e-42b1-4461-b07b-7b1536d6c0c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.027460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3710025e-42b1-4461-b07b-7b1536d6c0c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.028220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3710025e-42b1-4461-b07b-7b1536d6c0c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.028648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3710025e-42b1-4461-b07b-7b1536d6c0c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.059357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3710025e-42b1-4461-b07b-7b1536d6c0c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046516 Jun 17 13:18:44.059959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1284/2660] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:44.409070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:44.410383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:44.417111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.417561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.418335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.418743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.486390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:44.498122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7a2fef87-6f47-4f45-8d72-073e4cb45335 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.095316 Jun 17 13:18:44.498715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1377/2661] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:44 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:45.074555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1bca9317-5cbe-45ad-9561-ff5117f8948d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:45.076082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1bca9317-5cbe-45ad-9561-ff5117f8948d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:45.087266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bca9317-5cbe-45ad-9561-ff5117f8948d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.088063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bca9317-5cbe-45ad-9561-ff5117f8948d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.089301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bca9317-5cbe-45ad-9561-ff5117f8948d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.090014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bca9317-5cbe-45ad-9561-ff5117f8948d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.124419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1bca9317-5cbe-45ad-9561-ff5117f8948d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056572 Jun 17 13:18:45.124976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1285/2662] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:45.516672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:45.517281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:45.524446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.524877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.525633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.526064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.599080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:45.611303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-48a04d4b-09d7-4d1d-a98a-00fd707ac79a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098334 Jun 17 13:18:45.612198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1378/2663] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:45 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:46.136475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f2226f6e-2708-430a-89f6-c9e1aea9859a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:46.137436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f2226f6e-2708-430a-89f6-c9e1aea9859a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:46.144693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2226f6e-2708-430a-89f6-c9e1aea9859a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.145164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2226f6e-2708-430a-89f6-c9e1aea9859a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.145925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2226f6e-2708-430a-89f6-c9e1aea9859a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.146362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2226f6e-2708-430a-89f6-c9e1aea9859a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.150087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:46.176604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f2226f6e-2708-430a-89f6-c9e1aea9859a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Jun 17 13:18:46.177212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1286/2664] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:46.632301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:46.633046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:46.642292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.642893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.644011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.644604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.650298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:46.713511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:46.724263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0d4d031e-200b-45a4-a8ad-9af1e388d135 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097389 Jun 17 13:18:46.724837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1379/2665] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:46 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:47.192338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6d34d76a-4738-44bb-a57d-bea480bd1fa9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:47.193288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6d34d76a-4738-44bb-a57d-bea480bd1fa9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:47.200282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d34d76a-4738-44bb-a57d-bea480bd1fa9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.200721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d34d76a-4738-44bb-a57d-bea480bd1fa9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:47.201474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d34d76a-4738-44bb-a57d-bea480bd1fa9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.201910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d34d76a-4738-44bb-a57d-bea480bd1fa9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:47.232548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6d34d76a-4738-44bb-a57d-bea480bd1fa9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Jun 17 13:18:47.233093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1287/2666] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:47.744483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:47.745286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:47.760005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.760582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:47.761569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.762132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:47.829184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:47.837905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c1d690c0-403d-4291-a692-c6af04ac09f5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098452 Jun 17 13:18:47.838439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1380/2667] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:47 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:48.245266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-85feb1dc-1615-485c-95cc-70866521ebb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:48.246177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-85feb1dc-1615-485c-95cc-70866521ebb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:48.253560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85feb1dc-1615-485c-95cc-70866521ebb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:48.254295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85feb1dc-1615-485c-95cc-70866521ebb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:48.255069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85feb1dc-1615-485c-95cc-70866521ebb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:48.255590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85feb1dc-1615-485c-95cc-70866521ebb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:48.285430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-85feb1dc-1615-485c-95cc-70866521ebb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Jun 17 13:18:48.286008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1288/2668] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:48.860077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:48.861101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:48.873341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:48.874115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:48.875355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:48.876125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:48.942798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:48.950458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b49989a-4c3e-43e6-9d0d-8e3b69bba59d tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.097044 Jun 17 13:18:48.951058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1381/2669] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:48 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:49.301661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d36b0fd5-79a3-4dcb-8040-9636a1b337b8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:49.302715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d36b0fd5-79a3-4dcb-8040-9636a1b337b8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:49.311261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d36b0fd5-79a3-4dcb-8040-9636a1b337b8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.311861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d36b0fd5-79a3-4dcb-8040-9636a1b337b8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:49.312816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d36b0fd5-79a3-4dcb-8040-9636a1b337b8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.313358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d36b0fd5-79a3-4dcb-8040-9636a1b337b8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:49.346820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d36b0fd5-79a3-4dcb-8040-9636a1b337b8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052072 Jun 17 13:18:49.347406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1289/2670] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:49 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:49.969502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:49.970169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:49.979838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.980355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:49.981432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.982104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:50.047448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:50.057894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9f43cb93-d0cc-4fd6-8152-72ae85e55e68 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093258 Jun 17 13:18:50.058451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1382/2671] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:49 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:50.359691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-341373b3-10d3-4657-b940-b43936d7896a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:18:50.361109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-341373b3-10d3-4657-b940-b43936d7896a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:50.368974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-341373b3-10d3-4657-b940-b43936d7896a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:50.369421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-341373b3-10d3-4657-b940-b43936d7896a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:50.370187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-341373b3-10d3-4657-b940-b43936d7896a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:50.370594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-341373b3-10d3-4657-b940-b43936d7896a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:50.451163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-341373b3-10d3-4657-b940-b43936d7896a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/action" status: 200 len: 75598 microversion: 2.1 time: 0.095504 Jun 17 13:18:50.452119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1290/2672] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 13:18:50 2022] POST /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a/action => generated 75598 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:51.078366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:51.079330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:51.090192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:51.091005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:51.092342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:51.093062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:51.156668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:51.164832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a7633624-a594-4399-a825-13622eba4bf0 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.093125 Jun 17 13:18:51.165406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1383/2673] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:51 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:52.186227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:52.187429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:52.198909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:52.199715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:52.200972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:52.201697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:52.268626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:52.277256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-74652edb-da3b-4381-b68c-a857da8b55f7 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.098051 Jun 17 13:18:52.277787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1291/2674] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:52 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:53.298188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:53.299204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:53.311101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:53.311845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:53.313098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:53.313819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:53.392004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:53.403400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ba9abe25-e256-4720-b886-c5cd250f4d6b tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.111701 Jun 17 13:18:53.404211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1384/2675] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:53 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:54.426352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:54.427445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] [instance: 7e78628d-5386-4d24-adb0-9ea06bce2e6f] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:54.435278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:54.435754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:54.436516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:54.436945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:54.500332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '109a46a7108e48c48407681b3e5b1e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f6238effd43d39cbf0af0f4c582f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:54.508134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-715db631-0391-4efc-bb81-b8b54c5a8a7a tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f" status: 200 len: 1217 microversion: 2.1 time: 0.088373 Jun 17 13:18:54.508700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1292/2676] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:54 2022] GET /compute/v2.1/servers/7e78628d-5386-4d24-adb0-9ea06bce2e6f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:54.705977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2221002-6a39-4363-bb2f-1b6b1a0645e5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] Calling method '.version_select at 0x7f455313a790>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:54.729188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2221002-6a39-4363-bb2f-1b6b1a0645e5 tempest-TestShelveInstance-770139496 tempest-TestShelveInstance-770139496-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-82634216" status: 202 len: 0 microversion: 2.1 time: 0.027076 Jun 17 13:18:54.729834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1385/2677] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:18:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-82634216 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:18:57.259924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.260546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.267135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.267602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.268367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.268873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.298609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:18:57.302900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.304257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.312457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.313175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.314128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.314722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.348943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:18:57.415691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f8e1c02-d75d-4435-a697-718b7c655697 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 204 len: 0 microversion: 2.1 time: 0.158229 Jun 17 13:18:57.417152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1293/2678] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:18:57 2022] DELETE /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:18:57.423536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.424864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.432203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.432706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.433420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.433892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.492810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:18:57.496791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d03687ae-32fe-4dc6-9843-ae396570d26b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 204 len: 0 microversion: 2.1 time: 0.196500 Jun 17 13:18:57.498521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1386/2679] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:18:57 2022] DELETE /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:18:57.505994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.507179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.516159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.516730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.517960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.518476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.604887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9c885787-d19d-42c1-884d-75d5e9c73247 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 204 len: 0 microversion: 2.20 time: 0.185752 Jun 17 13:18:57.610969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1294/2680] 10.222.0.87 () {60 vars in 1279 bytes} [Fri Jun 17 13:18:57 2022] DELETE /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 13:18:57.619598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.620428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.627325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.628111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.628563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.628994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.691404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:57.700563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ab3dbbcf-868c-4f20-9d5c-757d4608fad8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.199924 Jun 17 13:18:57.711514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1387/2681] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:57 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:57.711514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.711514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.721562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.722012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.722785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.723216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.909579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:57.921227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-55d88175-cddb-44b2-b6ba-b69f1de6d4dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1726 microversion: 2.1 time: 0.308703 Jun 17 13:18:57.924622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1295/2682] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1726 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:57.937662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3df8aa38-673f-4c1b-ad0c-49fb0ebe1bdb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] Calling method '.version_select at 0x7f454eb8ee50>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.953611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:57.968178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:57.971573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:57.974915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e38aefdf-c664-4c98-bc93-4d14d63064fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.272229 Jun 17 13:18:57.976077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1388/2683] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:18:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:18:57.993430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3df8aa38-673f-4c1b-ad0c-49fb0ebe1bdb tempest-TestVolumeBootPattern-2141443264 tempest-TestVolumeBootPattern-2141443264-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1048624945" status: 202 len: 0 microversion: 2.1 time: 0.059872 Jun 17 13:18:57.994268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1296/2684] 10.222.0.87 () {58 vars in 1262 bytes} [Fri Jun 17 13:18:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1048624945 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:18:58.720295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:58.721668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:58.729196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.729910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.730901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.731535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.946070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:58.946704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:58.956147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.956597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.957376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.958050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.999762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:59.009401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6374eb68-4df6-4f30-8cf0-1b13b3e7372e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.293556 Jun 17 13:18:59.020199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1389/2685] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:58 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:59.031955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:59.032181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:59.039180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:59.039699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:59.040473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:59.040906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:59.268635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:59.281191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:59.283623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:59.284988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7473355c-0577-4a5b-883a-a6f16d4cdff3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.263436 Jun 17 13:18:59.285648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1390/2686] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:18:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:18:59.318717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:18:59.329316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0c57c625-1537-4a05-a0a8-a8331e70932a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1726 microversion: 2.1 time: 0.387862 Jun 17 13:18:59.333118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1297/2687] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:18:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1726 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:18:59.719225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-a0772300-a8a1-42a6-b4b6-afc199df1bb4 req-97d3f6ff-c5b0-4a06-815d-79e579fb90dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ab137b-ba6b-4ea1-96d9-2cad4c99cc75", "name": "network-vif-deleted", "tag": "03578bdb-440d-45ad-9a69-0e303f40d8ec"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:18:59.737610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-a0772300-a8a1-42a6-b4b6-afc199df1bb4 req-97d3f6ff-c5b0-4a06-815d-79e579fb90dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:59.739111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-a0772300-a8a1-42a6-b4b6-afc199df1bb4 req-97d3f6ff-c5b0-4a06-815d-79e579fb90dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:59.755213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-a0772300-a8a1-42a6-b4b6-afc199df1bb4 req-97d3f6ff-c5b0-4a06-815d-79e579fb90dc service nova] Creating event network-vif-deleted:03578bdb-440d-45ad-9a69-0e303f40d8ec for instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 on hv-cinder-84617 Jun 17 13:18:59.763651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-a0772300-a8a1-42a6-b4b6-afc199df1bb4 req-97d3f6ff-c5b0-4a06-815d-79e579fb90dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162289 Jun 17 13:18:59.765283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1391/2688] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:00.026120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:00.027364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:00.034745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.035491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.036461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.037058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.305005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:00.306798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:00.315751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.316531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.317968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.318898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.321096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:00.344615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eca8fbbe-e104-406a-9c10-c4471a8dc2d6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.322294 Jun 17 13:19:00.355073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1298/2689] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:00 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:00.355073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:00.355073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:00.365857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.366509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.367184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.369927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.692898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:00.722600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:00.724463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:00.726225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9d5aefbc-f254-4de7-b37f-fb42ae89c378 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.426102 Jun 17 13:19:00.727117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1392/2690] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:19:00.744367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:00.756266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6e8d66d-7806-44ae-9c0e-ecfd8a90ca51 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.408654 Jun 17 13:19:00.757994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1299/2691] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:01.361964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:01.363194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:01.373026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.373456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.374225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.374650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.728902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:01.737410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-83e30aa4-8402-44ed-8450-c531138f9a80 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.379163 Jun 17 13:19:01.738211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1393/2692] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:01 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:01.746014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:01.746648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:01.754084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.754793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.755594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.756217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.774859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:01.775688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:01.783831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.784627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.785631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.786209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.879508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:01.889339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5dca3b5c-8773-42e7-8e13-ec49f87aeadd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.118867 Jun 17 13:19:01.890497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1394/2693] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:02.072431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:02.084059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:02.095145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:02.097754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:02.101341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d73df488-cbf8-4871-9aa4-06e9656dfcaa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.359740 Jun 17 13:19:02.114245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1300/2694] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:02.757969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:02.758625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:02.770282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.775295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:02.776241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.777135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:02.919843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:02.921194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:02.934745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.935920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:02.936981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.937821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:03.007403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:03.012623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:03.021882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f5bf76e4-0d7c-4c63-9589-521e6307def9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.269675 Jun 17 13:19:03.031790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1395/2695] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:02 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:03.141344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:03.144247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:03.146331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:03.156332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1eed3d55-3c09-4ed0-89c9-4a0353f98e10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.252828 Jun 17 13:19:03.157746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1301/2696] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:03.159555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:03.160246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:03.161378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:03.165360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:03.469137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:03.482572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:03.485541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:03.486952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f91fcb20-fea0-4a72-9d59-406918b78d09 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.357650 Jun 17 13:19:03.487445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1396/2697] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:04.039130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:04.040412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:04.056930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.057375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.058151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.058573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.176187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:04.178099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:04.189772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.190504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.191732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.195551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.308306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:04.316848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bed21c74-e96e-4bd4-89f6-bc86d735bb48 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.145258 Jun 17 13:19:04.327615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1397/2698] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:04.373063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:04.391256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7ccc6c6f-9903-4160-9c8b-d617fb303a13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.355980 Jun 17 13:19:04.392751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1302/2699] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:04 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:04.506841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:04.507671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:04.510201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:04.529959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.530446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.531177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.531818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.840030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:04.851132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:04.853526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:04.855194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-69387151-bb4a-4092-b057-8d5129101c21 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.352923 Jun 17 13:19:04.863647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1398/2700] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:05.334288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:05.336744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:05.344012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.344632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.345559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.346172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.408624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:05.409251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:05.419954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.420699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.421660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.422271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.444735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:05.454507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6b019b4f-6b96-4026-a9b5-f0a672b25254 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.124116 Jun 17 13:19:05.465298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1303/2701] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:05.623633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:05.634024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1177aef8-e637-40e7-8f9b-72ca1aeed7d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.228917 Jun 17 13:19:05.634732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1399/2702] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:05 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:05.875278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:05.876198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:05.888183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.889041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.890126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.890634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.169461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:06.181760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:06.183492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:06.185011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c61013d7-0a92-4aa2-8667-8db08f1e9bbf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.314851 Jun 17 13:19:06.185786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1304/2703] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:19:06.473709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:06.475764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:06.487552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.488085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.488909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.489553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.576390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:06.585506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b5635a5f-5bef-4439-9359-fddf72662084 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.116989 Jun 17 13:19:06.586192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1400/2704] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:06.657500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:06.658434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:06.668574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.669253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.670234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.670879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.889786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:06.900519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a90d16db-8a6e-42ab-ac02-0c8f2d95ff2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.248466 Jun 17 13:19:06.901368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1305/2705] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:06 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:07.205520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:07.206240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:07.213174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:07.213679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:07.214505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:07.214960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:07.400572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:07.409499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:07.410976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:07.412162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6347dcdd-cf6b-45aa-969b-9b35e23dd356 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.210561 Jun 17 13:19:07.412775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1401/2706] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:07.602259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:07.602880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:07.609201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:07.609646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:07.610408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:07.610844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:07.677154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:07.685922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd953edd-fba4-40af-b239-f44930ecc6c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087619 Jun 17 13:19:07.686745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1306/2707] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:07.919162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:07.920006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:07.927163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:07.927695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:07.928593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:07.930011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.080702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:08.092575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4117c133-4744-43cf-8a2d-340b16124c15 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.176758 Jun 17 13:19:08.103861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1402/2708] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:07 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:08.431654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:08.432160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:08.438882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.439318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.440131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.440534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.594015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:08.607189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:08.609564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:08.611284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff0423c3-ac05-4b29-a980-93de226e1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.184047 Jun 17 13:19:08.612026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1307/2709] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:08.706265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:08.706947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:08.714791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.715239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.716035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.716478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.779567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:08.792751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f98d9168-279c-4145-9543-6344b6c274dc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092967 Jun 17 13:19:08.793572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1403/2710] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:09.111728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:09.112654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:09.122458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.123192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.124614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.125429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.270521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:09.279505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3ed6126a-1c95-4f7c-b2dc-c0979ce766bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173340 Jun 17 13:19:09.280159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1308/2711] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:09 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:09.632233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:09.633050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:09.639868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.640315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.641070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.641499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.775736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:09.784622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:09.786106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:09.787259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-86b7bd3f-1431-4250-83b3-152fbaa03c26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158992 Jun 17 13:19:09.787852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1404/2712] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:09.814411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:09.815061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:09.821689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.822137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.822898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.823308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.888665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:09.897126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-74d9a323-6b29-44b4-b8f1-d5aa1e9c091c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086654 Jun 17 13:19:09.897678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1309/2713] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:10.298267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:10.298882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:10.305994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.306441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.307206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.307675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.441063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:10.449399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef97bf8d-4fe4-41cb-a62f-498bbcc33463 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155116 Jun 17 13:19:10.449973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1405/2714] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:10 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:10.806829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:10.807488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:10.814431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.814878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.816265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.816744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.914379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:10.915009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:10.921698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.922139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.922899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.923323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.949956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:10.959108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:10.961102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:10.962285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3ba566a9-cd2b-4255-80aa-8f37ce0dc4a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159884 Jun 17 13:19:10.962859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1310/2715] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:10.986169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:10.994308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-519e1f10-c9cb-4824-a20e-ec56ef692959 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084053 Jun 17 13:19:10.994865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1406/2716] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:11.466643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:11.467159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:11.473566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.473980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:11.474748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.475209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:11.612018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:11.620780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-512e9f2e-7050-417f-8623-2ed85e2d8235 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158229 Jun 17 13:19:11.621355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1311/2717] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:11 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:11.981598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:11.982240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:11.989475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.989922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:11.990682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.991135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.012530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:12.013236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:12.015645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:12.021207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.021658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.022427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.022853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.092227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:12.100370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-26ab6aa5-92cc-43a6-aa98-0ed39f09a22c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091825 Jun 17 13:19:12.100943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1312/2718] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:12.135992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:12.144924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:12.146451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:12.147655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6488527e-cf08-4059-95cb-182228212c81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170084 Jun 17 13:19:12.148392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1407/2719] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:12.638779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:12.639414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:12.645896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.646331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.647079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.647563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.778101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:12.786250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a78d0bfb-5c46-4bd8-8edc-b634aff85a10 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.151414 Jun 17 13:19:12.786805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1313/2720] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:12 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:13.118252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:13.118965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:13.126513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.126962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.127744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.128180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.166369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:13.167051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:13.174294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.174834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.175638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.176086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.193559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:13.202289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4b648b7d-5c86-44d1-afb5-449536344fd3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088148 Jun 17 13:19:13.202873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1408/2721] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:13.316482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:13.326529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:13.328066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:13.329226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-404466f3-a9aa-45c2-a68e-b22f478a1022 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166800 Jun 17 13:19:13.329783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1314/2722] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:13.807187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:13.808036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:13.816582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.817177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.818175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.818749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.960545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:13.968692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5bd00512-5541-400d-a2a2-1a3ff4a87155 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167518 Jun 17 13:19:13.969236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1409/2723] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:13 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:14.223426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:14.224315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:14.232056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.232497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.233256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.233689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.297881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:14.306516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02ad5503-beb6-45a3-83db-7b6f40085c20 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088742 Jun 17 13:19:14.307082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1315/2724] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:14.347985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:14.348617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:14.355806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.356244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.357018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.357447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.503984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:14.513493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:14.514956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:14.516140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-334d8706-2e1a-4982-a2ac-6cba80d77c06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172153 Jun 17 13:19:14.516695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1410/2725] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:14.989910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:14.990935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:15.001877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.002640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.003941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.004713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.141493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:15.150149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b25e5e77-ba98-451c-9570-b9b41cc45aff tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166814 Jun 17 13:19:15.150719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1316/2726] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:14 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:15.334189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:15.335287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:15.342476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.343745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.344914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.345517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.415289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:15.424086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ad2c662d-9e5a-45e1-9c8d-b3a5bd1858e3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097296 Jun 17 13:19:15.424651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1411/2727] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:15.537354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:15.537959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:15.545691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.546129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.546873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.547333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.568270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:15.713668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:15.724204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:15.725716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:15.727135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-94a41cb4-39fa-43bd-a879-aeee649b4ae9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.193757 Jun 17 13:19:15.727735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1317/2728] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:16.173253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:16.173860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:16.180521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.180966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.181716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.182139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.200058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:16.337029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:16.349644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dafa06a8-6ab5-432e-a086-4ce5a14b2008 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.180166 Jun 17 13:19:16.350506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1412/2729] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:16 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:16.445904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:16.446577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:16.453507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.453982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.454767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.455189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.519657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:16.532152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a6caf829-f684-4b6e-b26d-b54201923caf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092667 Jun 17 13:19:16.532871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1318/2730] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:16.746268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:16.747211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:16.754336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.754781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.755571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.755998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.892583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:16.901540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:16.903040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:16.904229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-46211883-ad43-41d2-bbbe-99c1f14fe190 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162364 Jun 17 13:19:16.904798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1413/2731] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:17.368602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:17.369340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:17.377770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.378408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.379187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.379703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.527047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:17.535458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a740661-7431-4ae2-9443-1e476eba8416 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171501 Jun 17 13:19:17.536017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1319/2732] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:17 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:17.554559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:17.555716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:17.562215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.562658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.563439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.563887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.633468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:17.641749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9431e735-d172-430e-823a-0cd79f4f1d1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092793 Jun 17 13:19:17.642325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1414/2733] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:17.922175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:17.922698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:17.929323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.929766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.930517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.930954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.078494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:18.093736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:18.095306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:18.096503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd47b60d-b625-4529-b920-53edac3dcf7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178515 Jun 17 13:19:18.097058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1320/2734] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:18.555537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:18.556357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:18.566765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.567466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.568656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.569321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.659864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:18.660509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:18.668107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.668561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.669324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.669806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.721425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:18.729719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0ea0719d-cc2f-4454-9e92-c031f562a87b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.180428 Jun 17 13:19:18.730263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1415/2735] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:18 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:18.734348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:18.742505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c92cafc5-c27b-4e6b-82b8-e174217ce8f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086601 Jun 17 13:19:18.743097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1321/2736] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:19.119544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:19.120152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:19.128394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.128984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.130094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.130673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.269056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:19.282303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:19.284669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:19.286345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-24454383-a0fd-4352-ac06-e85458a07f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173078 Jun 17 13:19:19.287114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1416/2737] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:19.752241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:19.753209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:19.763720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:19.764237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.764333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:19.764429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.765137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.765577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.771208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.771691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.772458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.772894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.843307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:19.852543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-45e9c29d-a7ba-4eb0-b60d-757a6bf18a64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.095262 Jun 17 13:19:19.853313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1417/2738] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:19.902763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:19.910974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d2ad239e-8e28-4617-8a2d-6d31b25313b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166233 Jun 17 13:19:19.911589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1322/2739] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:19 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:20.310080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:20.310900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:20.317484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.318055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.318838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.319275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.468633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:20.477655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:20.479150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:20.480347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b3c5c41-e5e7-4480-bc43-84f36f9a1249 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176884 Jun 17 13:19:20.480906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1418/2740] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:20.870998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:20.872018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:20.879214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.879704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.880473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.880937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.930408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:20.931296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:20.939917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.940364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.941167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.941569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.953604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:20.962033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4ac5af83-9531-442c-915a-3b7106d84cc0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.095399 Jun 17 13:19:20.962658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1323/2741] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:21.073288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:21.081783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-919952d8-cd8a-4e66-9387-0c0383de4bb0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156260 Jun 17 13:19:21.082361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1419/2742] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:20 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:21.501817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:21.502426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:21.509109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.509553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:21.510322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.510755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:21.663282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:21.677955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:21.679481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:21.680967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1335417-0361-4ed0-a327-57ecebe4f6c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.184038 Jun 17 13:19:21.681772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1324/2743] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:21.979357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:21.980033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:21.987801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.988246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:21.989007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.989466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.054034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:22.062527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-579f8506-2a44-45ce-a9a0-b157fae6b58e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087154 Jun 17 13:19:22.063136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1420/2744] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:22.099550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:22.100154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:22.107474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.107928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.108698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.109132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.273615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:22.283875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-faba7ad2-8bff-48fe-b490-ec55cbb76b62 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.188536 Jun 17 13:19:22.284448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1325/2745] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:22 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:22.702111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:22.702712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:22.709479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.709934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.710688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.711118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.857739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:22.867114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:22.868648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:22.869806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b5269cb0-5160-41af-b9e6-fbcd9ebb7a0c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172302 Jun 17 13:19:22.870369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1421/2746] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:23.081840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:23.082387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:23.089003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.089447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:23.090197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.090624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:23.156998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:23.168670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1e91385f-87ab-4f7d-99f6-8e0b881c460e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090558 Jun 17 13:19:23.169731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1326/2747] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:23.305320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:23.306509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:23.314798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.315237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:23.316055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.316486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:23.462371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:23.476164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2bf685c1-b70d-46fc-ae30-9c174840ec3d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.176893 Jun 17 13:19:23.476928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1422/2748] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:23 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:23.894629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:23.895706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:23.906684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.907154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:23.907974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.908398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:24.058033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:24.066909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:24.068457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:24.069609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1745cd4-4427-4e79-976d-a9e744318d81 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.181950 Jun 17 13:19:24.070160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1327/2749] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:24.189259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:24.190086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:24.197980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:24.198431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:24.199194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:24.199659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:24.277482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:24.286361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2e795dd-993b-4300-bc40-271aac3cc616 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.103647 Jun 17 13:19:24.286958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1423/2750] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:24.500739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:24.501369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:24.508640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:24.509160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:24.510012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:24.510518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:24.654478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:24.663483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b8ef7011-aeeb-4d7d-975c-c42e882709c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.169849 Jun 17 13:19:24.664056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1328/2751] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:24 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:25.092510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:25.093679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:25.104094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.104889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.106151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.106873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.252647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:25.261766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:25.263271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:25.264471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a28f0ac9-0762-4b61-96d8-0106e648af27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178644 Jun 17 13:19:25.265090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1424/2752] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:25.308299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:25.308916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:25.315778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.316231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.316993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.317434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.380599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:25.389393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5ff02a25-58ae-4685-bda1-8771c2a4c42f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084983 Jun 17 13:19:25.389966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1329/2753] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:25.681301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:25.681789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:25.688476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.688940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.689773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.690206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.826223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:25.835507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d71ef427-4f32-4fd2-b324-26870f0fe7d2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158253 Jun 17 13:19:25.836057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1425/2754] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:25 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:26.287004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:26.287851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:26.298605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.299053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.299816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.300248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.406639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:26.407245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:26.414056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.414499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.415257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.415720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.432095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:26.441035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:26.442554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:26.443757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1fc0efae-90f6-4178-b72f-8e47ea0cc126 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163528 Jun 17 13:19:26.444345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1330/2755] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:26 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:26.482697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:26.491354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f20a4ea-23f4-4a44-8ea5-e160ad8473ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089118 Jun 17 13:19:26.491955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1426/2756] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:26.856542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:26.857484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:26.867585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.868527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.869655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.870320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.012850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:27.023350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cc73cf31-bc21-4f4f-8444-a71e78a2c719 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.172380 Jun 17 13:19:27.024208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1331/2757] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:26 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:27.463713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:27.464879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:27.472919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.473464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.474231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.474706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.509325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:27.510155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:27.517300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.517778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.518541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.518970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.581874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:27.589912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e5f8a1f8-96a3-4727-91a9-01be10ef47d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084499 Jun 17 13:19:27.590478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1332/2758] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:27.608849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:27.617715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:27.619190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:27.620367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b72214fb-652d-4ec4-b444-49eebfe0c7fa tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161735 Jun 17 13:19:27.620933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1427/2759] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:28.045124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:28.045738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:28.052775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.053224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.053976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.054407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.195771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:28.208407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc9e9343-4409-4fae-b140-20e419416cc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166924 Jun 17 13:19:28.209298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1333/2760] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:28 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:28.610908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:28.611587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:28.618363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.618834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.619625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.620063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.639032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:28.639682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:28.646702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.647150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.647961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.648395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.652498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:28.686153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:28.695404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-74a0bc76-a409-4ec1-829e-edb6478b5ff5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090360 Jun 17 13:19:28.695998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1428/2761] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:28.792812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:28.802810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:28.804605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:28.805985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-69c5eae5-0e46-4095-b186-49ef2687c340 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170934 Jun 17 13:19:28.806620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1334/2762] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:29.231721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:29.232491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:29.240739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.241437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.242671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.243340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.250055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:29.390119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:29.398862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ae032952-b6af-471a-a42a-762112bbea20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.172043 Jun 17 13:19:29.399467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1429/2763] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:29 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:29.716384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:29.717318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:29.725675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.726124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.726883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.727311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.797931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:29.807226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6823ccfc-031c-4695-adf9-34930a3bb7b5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097613 Jun 17 13:19:29.807953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1335/2764] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:29.826687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:29.827253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:29.835316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.835808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.836871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.837499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.975667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:29.987009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:29.988556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:29.989727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe86c47f-0cae-4bfa-a48b-bb727db840a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168220 Jun 17 13:19:29.990295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1430/2765] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:30.419175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:30.420040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:30.428497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.429147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.430200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.430742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.563559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:30.573557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6aa4950c-8104-41e9-895e-3ba78ecee1de tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160244 Jun 17 13:19:30.574126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1336/2766] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:30 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:30.828063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:30.828668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:30.836317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.836768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.837529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.837963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.909117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:30.917310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3e1cfc09-7c0b-48ad-9454-32e0591f8a6d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094549 Jun 17 13:19:30.917890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1431/2767] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:31.014010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:31.014751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:31.023143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.023755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.024715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.025213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.164406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:31.176055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:31.177809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:31.179417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b937e4a5-76f5-4488-9c4c-65df0afe6b3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171240 Jun 17 13:19:31.180136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1337/2768] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:31.591669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:31.595799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:31.606359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.607379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.608161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.608596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.757089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:31.769713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7d964c37-8adb-49fa-99e5-cb8e9017ae4d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.181691 Jun 17 13:19:31.770384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1432/2769] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:31 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:31.940452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:31.941641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:31.949304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.949926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.950760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.951396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.023590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:32.032709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-90682d70-7aa0-4d57-aca2-a96ddd8ca9e4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.100134 Jun 17 13:19:32.033356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1338/2770] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:32.201582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:32.202129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:32.209345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.209799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.210560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.210998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.354641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:32.364795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:32.366489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:32.367792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bdd0d53e-b278-4085-b046-ab3848aff7a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170207 Jun 17 13:19:32.368457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1433/2771] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:32.789174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:32.789822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:32.796768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.797255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.798010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.798445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.948554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:32.960880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2aa3e49b-b1bb-4248-8fbd-490f9cabb8d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.176416 Jun 17 13:19:32.961731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1339/2772] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:32 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:33.056975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:33.057590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:33.064759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.065232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.066104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.066601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.138108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:33.148793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-10bbc2a6-c34a-47e8-ba23-50463aa2783a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097680 Jun 17 13:19:33.149350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1434/2773] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:33.389031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:33.389612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:33.398289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.399101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.400233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.400812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.536457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:33.546305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:33.547875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:33.549020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4ff1bed3-a306-4fd4-9f40-85302d8ecc58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164840 Jun 17 13:19:33.549581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1340/2774] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:33.979927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:33.980595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:33.987558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.987999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.988754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.989182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.134747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:34.144096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a5ae3489-de1c-425d-a9ce-d5cf8d814bbd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.168251 Jun 17 13:19:34.146003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1435/2775] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:33 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:34.171015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:34.172570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:34.181271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.181713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.184593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.185030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.253641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:34.262727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-611678fa-30a0-4580-991e-6f47fcbc159a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097406 Jun 17 13:19:34.263276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1341/2776] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:34.572206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:34.573211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:34.576342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=76 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:34.582742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.583234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.584067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.584544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.715745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:34.724409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:34.725893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:34.727755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5f9d9cc8-1a6d-411f-b120-73acd0d6bc4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163670 Jun 17 13:19:34.728290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1436/2777] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:35.161815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:35.162431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:35.169608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.170055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.170810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.171257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.284461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:35.285572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:35.302839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.303990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.311044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.311838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.330273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:35.341060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-da42687e-15bf-41fe-9fa1-74096d35e2ef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.183184 Jun 17 13:19:35.341848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1342/2778] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:35 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:35.389775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:35.401014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e6e16918-b83e-4c34-a45a-e32f5c3885da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.123987 Jun 17 13:19:35.401571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1437/2779] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:35.750783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:35.751846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:35.760645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.761088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.761956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.762381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.913161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:35.922857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:35.924397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:35.925654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b2a4a11e-2b26-4de1-8373-1a77dcdf37a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.181993 Jun 17 13:19:35.926204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1343/2780] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:36.362505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:36.363444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:36.375837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.376560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.377793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.378504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.420496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:36.421117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:36.428396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.428837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.430216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.430347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.495536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:36.504161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cfcceea5-b083-4c84-9231-6879ff32e3c0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089400 Jun 17 13:19:36.504730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1344/2781] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:36.520240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:36.528324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-921aa7c5-5418-4fbe-93a8-af9aac937c4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.172487 Jun 17 13:19:36.528880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1438/2782] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:36 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:36.948990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:36.949497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:36.956322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.956772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.957528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.957960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.097271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:37.106825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:37.108334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:37.109481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bff8d27e-83cd-4cc9-84ef-79a3dfcb0d11 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165782 Jun 17 13:19:37.110041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1345/2783] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:37.525861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:37.526937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:37.534434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.534879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.535675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.536116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.546201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:37.546793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:37.553423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.553873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.554632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.555076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.599581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:37.608025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0b902619-3339-4cb2-b37e-b1c2ae0fa8d5 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089249 Jun 17 13:19:37.608606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1439/2784] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:37.690734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:37.702314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ebc48e48-3d05-4f33-bfe6-cdae46424cf7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160246 Jun 17 13:19:37.702894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1346/2785] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:37 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:38.128414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:38.129031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:38.135326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.135805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.136613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.137108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.275007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:38.283872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:38.285355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:38.286508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-225a0afa-743c-4ec1-8b5a-c8df5e2a3391 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162207 Jun 17 13:19:38.287022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1440/2786] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:38.628543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:38.629215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:38.638890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.639346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.640132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.640567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.713369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:38.722181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-455831bf-16d3-445a-8e6d-41f5f7e4a294 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099292 Jun 17 13:19:38.722762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1347/2787] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:38.725136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:38.725750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:38.733183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.733706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.734832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.735417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.880195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:38.892664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ff14a0e1-0ab5-40b9-8c87-c5e861e554d8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171523 Jun 17 13:19:38.893412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1441/2788] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:38 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:19:39.308016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:39.308943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:39.319170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.319903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.321065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.321721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.466764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:39.475717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:39.477216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:39.478409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-714f2bde-608e-48ba-8ee7-be65c80b64ea tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176453 Jun 17 13:19:39.478933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1348/2789] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:39.743272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:39.744231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:39.753132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.753574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.754315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.754738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.831084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:39.840411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ede481f7-46fb-4fac-ac97-8e20ad9ca0d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.103561 Jun 17 13:19:39.841007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1442/2790] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:39.914500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:39.915637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:39.924179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.924628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.925391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.925828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.060882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:40.073526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8de79d1b-1522-43aa-b8b6-9074abc0c41e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165233 Jun 17 13:19:40.074301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1349/2791] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:39 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:40.500832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:40.501442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:40.508254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.508694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.509447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.509877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.646333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:40.655077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:40.656551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:40.657647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-723d907e-0622-46bf-a2ce-4e3c3939f8e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163329 Jun 17 13:19:40.658205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1443/2792] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:40.861115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:40.861692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:40.868853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.869346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.870177 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.870660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.934591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:40.938074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:40.943423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-77c9bbc3-3c88-4f2e-80e1-3cdbd32db0fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087786 Jun 17 13:19:40.944043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1350/2793] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:41.095976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:41.096976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:41.108470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.109206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.110511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.111330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.250849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:41.259736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f5ca8783-5058-40d8-9423-3663cfd568c2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.170678 Jun 17 13:19:41.260306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1444/2794] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:41 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:41.681123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:41.682164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:41.690599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.691049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.691874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.692310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.827343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:41.839112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:41.841505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:41.843586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cb494026-2a13-4618-86bd-3bbbbc034736 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169354 Jun 17 13:19:41.844148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1351/2795] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:41.964998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:41.965870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:41.973175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.973617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.974358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.974776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:42.038150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:42.041599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:42.046660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-38edd74b-14d8-4abd-a65f-707f73e248bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088172 Jun 17 13:19:42.047208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1445/2796] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:42.280818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:42.281580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:42.284947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=80 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:42.292450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:42.292987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:42.294096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:42.294682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:42.443896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:42.452714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-50b677ba-332b-4932-a67f-2c112fccd6fb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.177945 Jun 17 13:19:42.453560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1352/2797] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:42 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:42.863776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:42.864432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:42.872324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:42.872772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:42.873558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:42.873987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.008858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:43.019209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:43.020741 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:43.021938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f4109894-41d5-4a47-9f10-8a2691f90e79 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162335 Jun 17 13:19:43.022516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1446/2798] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:43.065513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:43.066447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:43.076398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.077075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.077922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.078376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.149761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:43.158462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-627b1db8-482b-4aec-b8fe-2b150c27c8c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098624 Jun 17 13:19:43.159039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1353/2799] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:43.477466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:43.478034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:43.485329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.485859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.486743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.487197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.630732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:43.639290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-269d6dfb-1d7d-45d9-9be9-38ce92ea9057 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166533 Jun 17 13:19:43.639890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1447/2800] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:43 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:44.040983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:44.041555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:44.048656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.049100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.049860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.050287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.175855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:44.176466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:44.183400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.183626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:44.183863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.184636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.185062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.192580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:44.194075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:44.195230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fbc816e4-221f-40c9-ae6c-4f203e797cbd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158264 Jun 17 13:19:44.195851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1354/2801] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:44.253855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:44.262411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2e6ada27-5026-4bf6-90db-11c1fbabb575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090549 Jun 17 13:19:44.262911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1448/2802] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:44.659904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:44.660428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:44.666975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.667475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.668334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.668763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.827914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:44.836763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9526bd73-d2ee-46e1-b0ba-0b9787ffbbcc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.182052 Jun 17 13:19:44.837305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1355/2803] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:44 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:45.219347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:45.220911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:45.231639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.232377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.233570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.234332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.279940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:45.280655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:45.287957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.288467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.289313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.289811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.359840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:45.371139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e474bfcc-354d-4342-882e-a58ea6994716 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094649 Jun 17 13:19:45.371931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1356/2804] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:45.381213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:45.389825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:45.391303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:45.392754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8509be59-e10d-4d1f-bc0b-252add22c24a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.181037 Jun 17 13:19:45.393376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1449/2805] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:45.856004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:45.856746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:45.864378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.864818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.865556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.865989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.998057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:46.010480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3b698a23-e01d-49d0-a7bd-2ce822f0e2d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159145 Jun 17 13:19:46.011397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1357/2806] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:45 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:46.394112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:46.395913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:46.405788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.406486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.407623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.408407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.413008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:46.413609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:46.421552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.422420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.423493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.424527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.476053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:46.484540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e5e49e31-454a-4188-88a6-ecbf1127071a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098314 Jun 17 13:19:46.485109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1450/2807] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:46.561267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:46.574454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:46.576863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:46.578599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0c7e4543-8851-478b-93b3-e6fb5e12cfdc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169458 Jun 17 13:19:46.579434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1358/2808] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:47.030318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:47.030953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:47.037731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.038191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.038933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.039358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.180153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:47.188840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1a6eb0b3-979e-4c77-bbb3-d7a939664f0f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162396 Jun 17 13:19:47.189789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1451/2809] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:47 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:47.503752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:47.504777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:47.511793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.512231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.512977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.513397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.588041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:47.598911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b8d05dfe-349e-4c10-893a-a50dc4566262 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099898 Jun 17 13:19:47.599523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1359/2810] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:47.602233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:47.602854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:47.609626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.610070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.610847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.611267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.756890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:47.766354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:47.767878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:47.769029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b296cf1-ba26-4446-8693-75adcf7a95d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170951 Jun 17 13:19:47.769567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1452/2811] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:19:48.206737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:48.207342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:48.213953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.214394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.215152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.215627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.351669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:48.359830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-27e298ea-f729-4559-ac33-fdaed66714ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156961 Jun 17 13:19:48.360398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1360/2812] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:48 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:48.616003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:48.616572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:48.623877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.624327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.625091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.625529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.689572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:48.697843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-54695220-1ddc-410f-8773-7b2dfc9a1c0b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086167 Jun 17 13:19:48.698408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1453/2813] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:48.787949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:48.788584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:48.795572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.796024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.796784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.797295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.942743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:48.952324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:48.953813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:48.954988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f87bc5ee-57cb-4ba8-88d9-729b6e1217e9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171196 Jun 17 13:19:48.955578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1361/2814] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:49.380939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:49.381614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:49.387888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.388357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.389161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.389586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.530092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:49.542743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ee27b355-de64-4b66-a592-a194eb822745 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167940 Jun 17 13:19:49.543339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1454/2815] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:49 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:49.719585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:49.720736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:49.732601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.733338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.734588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.735304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.811131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:49.821988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-25e9b675-db1e-4d6b-bb60-2ff84b35ee59 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.108946 Jun 17 13:19:49.822575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1362/2816] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:49.976456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:49.977158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:49.985690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.986249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.987191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.987775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.129797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:50.139097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:50.140644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:50.141795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-af447254-2d19-49c1-9c9a-567b3422ae43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171371 Jun 17 13:19:50.142359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1455/2817] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:50.564546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:50.565562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:50.572913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.573406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.574161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.574590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.709310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:50.718163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f3648933-eda8-4deb-b2ec-12c51fa7ac9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160848 Jun 17 13:19:50.718733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1363/2818] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:50 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:50.845656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:50.846521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:50.854397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.854845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.855614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.856038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.922924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:50.932375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c7a0c255-b003-4dcc-acf2-4a28906edee1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094915 Jun 17 13:19:50.932939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1456/2819] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:51.161545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:51.162147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:51.169624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.170074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.170828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.171258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.314938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:51.324004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:51.325498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:51.326656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48f5b509-9a48-4d82-aa0a-0abd6edb3f6b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169099 Jun 17 13:19:51.327216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1364/2820] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:51.735954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:51.736616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:51.744928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.745745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.746518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.746952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.894342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:51.905031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ea4a4025-05f1-4b3c-b970-654f1462c40b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.172772 Jun 17 13:19:51.905789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1457/2821] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:51 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:51.952505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:51.953112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:51.961966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.962407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.963161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.963578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.027583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:52.035873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1b01e23-ded0-43d9-850f-1d6e87ac8ff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088603 Jun 17 13:19:52.036511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1365/2822] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:52.349254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:52.349761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:52.356076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.356515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.357256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.357673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.494918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:52.507355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:52.509316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:52.511021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fd2da1b6-816b-48fa-aff5-e3d0d79389a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167856 Jun 17 13:19:52.511892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1458/2823] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:52.922640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:52.923264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:52.930557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.931015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.931826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.932262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.054010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:53.054621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:53.061339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.061785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.062554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.062994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.066123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:53.074821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9597002e-1b0c-48bd-b76d-f20eb0d826a3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156130 Jun 17 13:19:53.075634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1366/2824] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:52 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:53.138653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:53.147299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0ec2a177-a679-4270-b871-dd985c7e2070 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097306 Jun 17 13:19:53.147929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1459/2825] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:53.531451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:53.532410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:53.540998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.541434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.542181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.542601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.561706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:53.686300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:53.695617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:53.697122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:53.698289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bdc2655c-abf5-47fd-8ab6-a4a9c6b42af9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171924 Jun 17 13:19:53.698851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1367/2826] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:54.094840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:54.095751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:54.104747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.105374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.106442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.107061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.163880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:54.164498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:54.171303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.171792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.172556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.172990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.237146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:54.244379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:54.246097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-24f1d9b4-8ad2-4276-ad06-bbf9ee8b820e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086129 Jun 17 13:19:54.246679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1368/2827] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:54.252986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11260c16-7ab5-4d44-8aee-7c6d8cde1cac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164002 Jun 17 13:19:54.253582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1460/2828] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:54 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:54.721159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:54.722304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:54.733140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.733873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.735122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.735893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.879458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:54.888571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:54.890078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:54.891248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2057e195-c1b7-49ed-ad39-9662f86bf274 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176911 Jun 17 13:19:54.891885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1369/2829] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:55.263734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:55.264357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:55.270062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:55.270811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:55.271728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.271944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.272713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.273135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.278027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.278474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.279234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.279701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.338417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:55.346949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9781e6c7-611b-4e72-8f02-247a6d6753ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087080 Jun 17 13:19:55.347572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1461/2830] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:55.668283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:55.676579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8e905cc5-bb53-471c-8230-993070963b7b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.410411 Jun 17 13:19:55.677383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1370/2831] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:55 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:56.159895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:56.160502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:56.167049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.167426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.168204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.168607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.186838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:56.300894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:56.310134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:56.311656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:56.312817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3e8b7fe2-d9de-46a2-a7cb-8395b024b1d9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.406672 Jun 17 13:19:56.313345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1462/2832] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:56.494982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:56.496047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:56.502441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.502891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.503690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.504123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.569479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:56.579807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a0fae644-d975-453b-b8bd-73933df897aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.218560 Jun 17 13:19:56.580372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1371/2833] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:56.694510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:56.695110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:56.701970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.702419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.703176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.703641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.841823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:56.851360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-98d7c291-2247-4e43-81ae-f72913435f4a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160959 Jun 17 13:19:56.851981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1463/2834] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:56 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:57.331545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:57.332151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:57.339011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.339508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.340244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.340672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.478861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:57.487908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:57.489410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:57.490674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad93525e-392e-439f-8cdd-e5defce7a469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163196 Jun 17 13:19:57.491232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1372/2835] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:57.596926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:57.597545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:57.604442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.604887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.605673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.606105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.668885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:57.677645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e6fd416f-d0ac-40e0-9763-667f4290089a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084754 Jun 17 13:19:57.678134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1464/2836] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:57.869553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:57.870517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:57.877210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.877646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.878422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.878843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.012873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:58.021618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1d4ea6b-c147-4eba-97cb-b57cdb5311bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155933 Jun 17 13:19:58.022624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1373/2837] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:57 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:58.510086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:58.510689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:58.516995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.517440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.518225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.518659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.655501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:58.664604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:58.666111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:58.667262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-25af6d5e-003a-4228-b842-2305972dc773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161474 Jun 17 13:19:58.667844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1465/2838] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:58.694322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:58.694939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:58.702155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.702604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.703383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.703830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.780906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:58.789920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1e483a8e-26c5-43e7-91b8-ebe6267eae52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099391 Jun 17 13:19:58.790522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1374/2839] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:59.039231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:59.039778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:59.046686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.047129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.047933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.048366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.190145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:59.198964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9fd4aabe-d8f1-4233-b531-09cb2e2e4191 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163841 Jun 17 13:19:59.199576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1466/2840] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:59 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:19:59.686533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:59.687154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:59.694064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.694509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.695304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.695772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.807269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:59.808049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:59.815116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.815672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.816449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.816877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.829322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:59.838394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:59.839933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:59.841112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d00d39e9-38b0-4db2-9cb7-b9859db7efd5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158651 Jun 17 13:19:59.841670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1375/2841] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:19:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:19:59.881780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:19:59.890195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2297011-f6bb-4b1c-a39c-e44762dbd0c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086881 Jun 17 13:19:59.890769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1467/2842] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:19:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:00.216831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:00.217437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:00.224198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:00.224643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:00.225459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:00.225890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:00.365592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:00.379104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e4891eac-0fa9-45cd-abc2-9b97ba190d7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165772 Jun 17 13:20:00.380796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1376/2843] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:00 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:00.860219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:00.860834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:00.868339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:00.868843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:00.869594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:00.870390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:00.907710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:00.908303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:00.915563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:00.916007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:00.916776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:00.917196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:00.983751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:00.992913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b2bfc039-7705-443c-ad63-076fab31f810 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089187 Jun 17 13:20:00.993504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1377/2844] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:01.293591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:01.302408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:01.303959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:01.305322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-19e6dcae-74ce-4317-a228-581005da3ef7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.449121 Jun 17 13:20:01.306160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1468/2845] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:01.396172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:01.396794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:01.403250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:01.403732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:01.404462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:01.404924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:01.541988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:01.551798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-16c79f71-7558-4fe4-a657-54a969bebf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159148 Jun 17 13:20:01.552512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1378/2846] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:01 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:02.013868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:02.014797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:02.025962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.026757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.027617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.028267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.098582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:02.109801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7ca9cc92-5140-4d6e-85c5-37eaedab38bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.102219 Jun 17 13:20:02.110673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1469/2847] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:02.324537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:02.327697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:02.336463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.336911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.337699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.338127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.473674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:02.482451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:02.483990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:02.485160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-24826438-5f62-46fd-9f83-2ddd4e715e68 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164762 Jun 17 13:20:02.485714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1379/2848] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:02.569660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:02.570269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:02.576783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.577160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.577923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.578358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.710475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:02.718960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95ac50b1-f714-467b-8332-bb6eb6d7a1f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153578 Jun 17 13:20:02.719570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1470/2849] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:02 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:03.130187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:03.130807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:03.137339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.137787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.138537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.138971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.201318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:03.209522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6a427801-1ef9-4791-ac8c-eb28d8c04889 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083501 Jun 17 13:20:03.210078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1380/2850] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:03.504944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:03.506359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:03.513422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.513869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.514634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.515063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.651207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:03.660514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:03.662042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:03.663194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5c5c6b64-2a52-45d2-8a4b-3e0784b049e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162608 Jun 17 13:20:03.663792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1471/2851] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:03.736951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:03.737573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:03.745283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.745878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.746928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.747577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.889532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:03.897865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad06bcca-e0f1-4ae2-9e5e-435097b7e3a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164858 Jun 17 13:20:03.898435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1381/2852] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:03 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:04.227136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:04.227767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:04.234228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.234666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.235417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.235864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.297983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:04.306707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4b940655-7971-494d-8524-738fde04ffac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083783 Jun 17 13:20:04.307263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1472/2853] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:04.684413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:04.685059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:04.691650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.692144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.693128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.693574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.827399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:04.836502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:04.838006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:04.839152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-91907a46-68ab-4284-bae1-8085093e5d7c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160373 Jun 17 13:20:04.839769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1382/2854] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:04.917150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:04.917729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:04.920234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=74 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:04.925777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.926215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.926970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.927662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.062248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:05.071232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b0e8d46d-a1b5-4d47-9e2f-276dedd9a461 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158493 Jun 17 13:20:05.071846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1473/2855] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:04 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:05.324256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:05.324770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:05.331284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.331767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.332523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.333031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.396438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:05.405242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8581b84b-bcee-46cc-b5fd-761530c3f288 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085018 Jun 17 13:20:05.405813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1383/2856] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:05.858212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:05.858817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:05.866450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.866883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.867666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.868086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.003123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:06.014924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:06.016563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:06.017761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3f7f4314-101c-4999-8074-cfe82d657209 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163547 Jun 17 13:20:06.018318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1474/2857] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:06.089522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:06.090115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:06.097192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.097647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.098414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.098848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.102925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:06.240063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:06.248818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0d21c82f-0600-4a73-9bc5-ce1a594598d1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163316 Jun 17 13:20:06.249385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1384/2858] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:06 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:06.422695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:06.423204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:06.430472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.430906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.431683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.432106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.495977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:06.504424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f2b0271-b38c-4d59-b9b0-9df1890bb071 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085674 Jun 17 13:20:06.505091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1475/2859] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:07.037086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:07.037731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:07.044623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.045083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.045843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.046267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.179689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:07.188299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:07.189805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:07.190974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70e5e936-4942-4b0d-ada0-79df2d7ff9bc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158325 Jun 17 13:20:07.191544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1385/2860] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:07.267176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:07.267808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:07.274761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.275200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.276000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.276428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.315190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:20:07.315493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:20:07.411954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:07.422185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71249c72-b7d4-410f-9a6e-c8f851a494a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158590 Jun 17 13:20:07.423064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1476/2861] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:07 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:07.522267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:07.522862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:07.529696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.530145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.530929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.531334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.597874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:07.611504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8533b51b-8172-42c3-bdff-70f9e0d18f4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093538 Jun 17 13:20:07.612088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1386/2862] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:08.210297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:08.210940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:08.217921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.218376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.219137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.219610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.354421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:08.363285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:08.364958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:08.366125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-87669928-72d7-4739-9608-79ac988d5566 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160139 Jun 17 13:20:08.366677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1477/2863] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:08.440444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:08.441700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:08.448978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.449421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.450183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.450616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.590336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:08.598899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-90635ca0-a5b6-4852-8897-acb935002d5b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162394 Jun 17 13:20:08.599473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1387/2864] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:08 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:08.630551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:08.631165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:08.637634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.638086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.638838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.639267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.702125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:08.710656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2bd2beb3-e6c0-4bfe-b3df-067aa808c88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084352 Jun 17 13:20:08.711244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1478/2865] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:09.384744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:09.385262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:09.391861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.392299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.393112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.393589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.527196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:09.536491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:09.538048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:09.539214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eb903688-4d9a-479b-a3b2-fb0f46c37559 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158629 Jun 17 13:20:09.539779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1388/2866] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:09.616769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:09.617398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:09.624734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.625179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.625940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.626370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.630550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:09.728326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:09.728936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:09.735592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.736043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.736809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.737240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.763975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:09.772396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b77fce07-c23d-4bc2-879e-96b0e46ebc01 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159704 Jun 17 13:20:09.772970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1479/2867] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:09 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:09.801818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:09.809984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-71485b74-cf42-4c01-ad0b-bab411117b9d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085584 Jun 17 13:20:09.810543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1389/2868] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:10.557125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:10.557730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:10.564374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.564843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.565645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.566101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.701609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:10.710589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:10.712191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:10.713419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95219107-0087-417b-a231-9640bdd9a29b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160263 Jun 17 13:20:10.714016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1480/2869] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:10.790104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:10.790741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:10.797710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.798165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.798926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.799358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.827520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:10.828055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:10.834555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.835010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.835805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.836722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.900875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:10.909077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e67c8e0b-0d2e-4322-8f1e-adae2b9239be tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085497 Jun 17 13:20:10.909646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1481/2870] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:10.935231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:10.943833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bac28b46-0809-4164-aa19-b719dcb1c886 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157708 Jun 17 13:20:10.944415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1390/2871] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:10 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:11.732147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:11.732787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:11.739917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.740366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.741124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.741563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.878920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:11.888105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:11.889602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:11.890723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-21ecb639-b107-48b4-948c-3adf5c60ceb7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162574 Jun 17 13:20:11.891282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1482/2872] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:11.926324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:11.926974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:11.934261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.934704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.935519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.935942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.961317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:11.961930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:11.968158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.968601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.969470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.969824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:12.000184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:12.008680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0780c4c1-1bae-44c2-a1ab-b1a6fbce8698 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086368 Jun 17 13:20:12.009258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1391/2873] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:12.102436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:12.110724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-391a7a71-6e31-4c3b-af03-757c0f5c6bc5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153448 Jun 17 13:20:12.111561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1483/2874] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:11 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:20:12.909482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:12.910085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:12.912370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=80 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:12.918127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:12.918587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:12.919335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:12.919782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.025997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:13.026614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:13.033802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.034250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.035015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.035467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.056116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:13.064818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:13.066326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:13.067667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1652eaa8-b175-482a-84d7-de2d23d52f88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162086 Jun 17 13:20:13.068223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1392/2875] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:13.099973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:13.108305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-935ad043-d1cf-424f-ada9-751b2d8108fd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086276 Jun 17 13:20:13.108872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1484/2876] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:13.128562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:13.129353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:13.135844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.136287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.137045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.137480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.268754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:13.278278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cddfb66e-bb52-4b77-8bd4-8b968ceeeb93 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153285 Jun 17 13:20:13.279135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1393/2877] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:13 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:14.086415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:14.087017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:14.094118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.094588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.095345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.095820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.126548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:14.127117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:14.134455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.134905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.135726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.136161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.202008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:14.210512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ccaab800-3d43-4f87-9ab2-05c6c2b8cac8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087922 Jun 17 13:20:14.211094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1394/2878] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:14.235106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:14.244201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:14.246047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:14.247186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-780ab601-c439-49b9-91f0-dac6971aa377 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164857 Jun 17 13:20:14.247774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1485/2879] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:14.297801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:14.298458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:14.311476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.311984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.312777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.313210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.452355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:14.461601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f2f309e9-da74-43ce-9c73-976d6144dd54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167759 Jun 17 13:20:14.462820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1395/2880] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:14 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:15.037173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:20:15.037431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:20:15.229314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:15.230021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:15.236967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.237412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.238180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.238812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.265870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:15.266492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:15.275084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.275535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.276360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.276787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.303314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:15.311764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5d4bdf8f-c755-4cb1-994a-3104e925b111 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086532 Jun 17 13:20:15.312312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1486/2881] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:15.410125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:15.419486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:15.420991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:15.422149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3b2bdbb8-d010-4864-8149-3682ac7aaf34 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160273 Jun 17 13:20:15.422700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1396/2882] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:20:15.479901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:15.480504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:15.487057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.487531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.488326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.488973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.628372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:15.637632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49e5b1da-b468-41b7-aeac-7d6bbc417c04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161532 Jun 17 13:20:15.638221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1487/2883] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:15 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:16.329940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:16.330518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:16.337530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.337976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.338741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.339173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.405154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:16.413457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d6e875d2-f5be-4363-b331-ce6feb4e8377 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087545 Jun 17 13:20:16.414039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1397/2884] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:16.440441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:16.440996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:16.448069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.448513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.449289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.449722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.585601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:16.594137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:16.595671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:16.596824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f23c9ff0-1d9f-45db-83ba-91dcbac0785a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160299 Jun 17 13:20:16.597377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1488/2885] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:16.659155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:16.659807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:16.666544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.666987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.667768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.668192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.803627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:16.811841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bc8299d5-f78c-4b9c-be8d-e50902d13de9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157193 Jun 17 13:20:16.812408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1398/2886] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:16 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:17.430874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:17.431341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:17.437923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.438354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.439099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.439560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.502127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:17.510959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b8b1517a-fb9f-4236-be18-c549922597cd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084369 Jun 17 13:20:17.511545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1489/2887] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:17.615106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:17.615735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:17.622769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.623238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.624057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.624489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.770803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:17.779875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:17.781369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:17.782530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-69788856-ccab-4791-9dde-12e2da00c3cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171394 Jun 17 13:20:17.783079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1399/2888] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:17.829640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:17.830279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:17.836665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.837121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.837906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.838339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.971245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:17.979659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0950bdd7-6859-4a35-97b7-5619b31cad26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153826 Jun 17 13:20:17.980215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1490/2889] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:17 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:18.529225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:18.529837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:18.536585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.537032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:18.537799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.538230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:18.601196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:18.605748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:18.611057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47b10e03-fa09-4824-8c51-ac61af8b6eb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085861 Jun 17 13:20:18.611688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1400/2890] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:18.802036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:18.802625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:18.809788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.810237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:18.811003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.811467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:18.945642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:18.954305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:18.955831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:18.956974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f356f916-528c-4ed4-87cf-ca672f29b149 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159302 Jun 17 13:20:18.957639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1491/2891] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:18.998075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:18.998692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:19.006061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.006500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.007258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.007802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.145529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:19.153843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-611fe391-5cf9-419b-b55a-509da22111d3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160306 Jun 17 13:20:19.154390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1401/2892] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:18 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:19.628439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:19.629133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:19.635951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.636393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.637154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.637620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.705442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:19.714728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f6bd1e31-ec57-4c08-b03c-5d5175eae1b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090236 Jun 17 13:20:19.715309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1492/2893] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:19.976587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:19.977106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:19.983664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.984113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.984870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.985304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.132019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:20.140635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:20.142115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:20.143259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b4adc3bb-a6c8-484c-a7c1-d01d27427d88 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170860 Jun 17 13:20:20.143864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1402/2894] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:20.172412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:20.172988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:20.180252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.180686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.181430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.181869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.317685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:20.326031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43ce362c-6f88-44ae-97df-b47f79d16679 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157698 Jun 17 13:20:20.326600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1493/2895] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:20 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:20.737201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:20.737836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:20.744878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.745329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.746144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.746528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.808679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:20.816895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-751ec7eb-b604-4104-89bf-b1725d137e00 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083494 Jun 17 13:20:20.817494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1403/2896] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:21.162123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:21.162763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:21.169676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.170121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.170883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.171322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.304420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:21.313406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:21.314903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:21.316204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b260afab-6a60-44e6-b5db-e3b68dd91ec5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158042 Jun 17 13:20:21.316999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1494/2897] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:21.343917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:21.344624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:21.351691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.352139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.352897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.353323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.507209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:21.517145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-280e85bc-e894-4e38-8e21-9470e12ae61d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.177142 Jun 17 13:20:21.517773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1404/2898] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:21 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:21.834658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:21.835276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:21.845222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.845672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.846445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.846867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.915091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:21.918574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:21.923811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-63d62e0e-e141-4141-a886-99613e2689e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093901 Jun 17 13:20:21.924378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1495/2899] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:22.336370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:22.336869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:22.343845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.344982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.345801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.346505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.500430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:22.509560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:22.511065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:22.512270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e0acc817-aad8-432e-911c-38969b2a2b2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.181784 Jun 17 13:20:22.512831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1405/2900] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:22.534341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:22.534981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:22.542361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.542811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.543602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.544030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.681143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:22.689745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2d3b67c-c568-4693-9e67-891692afa42a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159318 Jun 17 13:20:22.690318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1496/2901] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:22 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:22.942099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:22.942722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:22.949359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.949803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.950611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.951084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.019533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:23.028058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5209ca15-cad5-40dc-a74c-60e88deaa8a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090075 Jun 17 13:20:23.028665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1406/2902] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:23.531598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:23.532203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:23.539496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.540138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.540689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.541109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.673291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:23.682262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:23.683792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:23.684954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c2d47643-7935-4bb6-bd54-a94cf9d2da3b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.157384 Jun 17 13:20:23.685519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1497/2903] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:23.707047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:23.707646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:23.714825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.715278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.716152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.716588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.849507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:23.859614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fb067451-fba7-4a8d-a356-b6b018433c53 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156533 Jun 17 13:20:23.860192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1407/2904] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:23 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:24.045922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:24.046538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:24.053033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.053478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.054252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.054688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.116921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:24.125711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-260e5f76-c84b-4e83-950d-df7c9b433d52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083779 Jun 17 13:20:24.126273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1498/2905] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:24.702963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:24.703695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:24.710409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.711030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.711671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.712107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.848397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:24.859116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:24.861773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:24.863688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a6bfa52-01e0-48a8-aa18-30fec13b3123 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164473 Jun 17 13:20:24.864414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1408/2906] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:24.878228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:24.878917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:24.885944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.886420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.887151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.887619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.022875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:25.031486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b0c8884-d80a-40ca-9e88-b64ca7e01f5a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157172 Jun 17 13:20:25.032027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1499/2907] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:24 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:25.142315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:25.142928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:25.149594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.150064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.150800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.151202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.218885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:25.227502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-96707ff7-3702-49f8-82be-a3d716d86dda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089001 Jun 17 13:20:25.227986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1409/2908] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:25.883229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:25.883978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:25.890925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.891401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.892188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.892622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.023510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:26.032375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:26.033875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:26.035562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fca0cebe-4396-4cc0-93c1-610f402385f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.156141 Jun 17 13:20:26.035699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1500/2909] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:26.049051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:26.049661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:26.056746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.057187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.057975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.058402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.189939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:26.200904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-69e65523-0494-449c-b0cc-f5136e689424 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155721 Jun 17 13:20:26.201546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1410/2910] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:26 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:26.245347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:26.245982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:26.252618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.253062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.253828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.254350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.319979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:26.328454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1d9bec6-8d29-48d4-9482-a4c5688c77d1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087461 Jun 17 13:20:26.329025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1501/2911] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:27.054693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:27.055275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:27.062297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.062746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.063547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.063981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.201031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:27.210070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:27.211619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:27.212801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48b4a272-9193-48c0-bd95-8c613a4251c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162534 Jun 17 13:20:27.213364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1411/2912] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:27.220468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:27.221041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:27.228174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.228623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.229393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.229833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.346224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:27.347010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:27.353647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.354121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.354875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.355303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.365437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:27.374418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a1fd7da7-2e20-453f-a59f-ffec99833e50 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157870 Jun 17 13:20:27.374995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1502/2913] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:27 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:27.421118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:27.429402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-572f20b1-ef54-44fb-ad05-b0dd73562ea9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087103 Jun 17 13:20:27.429978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1412/2914] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:20:28.231799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:28.232418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:28.239617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.240055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.240818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.241250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.375067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:28.383945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:28.385443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:28.386603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-84016042-7a40-4b71-a87b-12b41d04cd6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158817 Jun 17 13:20:28.387417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1503/2915] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:28.392625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:28.393303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:28.400911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.401358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.402129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.402561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.446307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:28.447087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:28.453494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.453942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.454712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.455144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.521284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:28.529488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-17fb1b4b-a66a-4916-bbe8-f594837d2c16 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087096 Jun 17 13:20:28.530038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1504/2916] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:20:28.537836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:28.546256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9e6c7d22-b426-474c-8c1c-14ee5538bda3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157584 Jun 17 13:20:28.546828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1413/2917] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:28 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:29.405760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:29.406361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:29.413402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.413846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.414614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.415046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.546249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:29.546833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:29.551607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:29.554095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.554580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.555322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.555801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.560838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:29.562336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:29.563551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0151763a-fcc9-459f-917a-45b410a063a4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162061 Jun 17 13:20:29.564110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1505/2918] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:29.568710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:29.569320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:29.575717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.576164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.576923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.577353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.621841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:29.630207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-221de3e8-ede3-4368-a93f-cc0dac9ffde1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087821 Jun 17 13:20:29.630823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1414/2919] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:20:29.714424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:29.723405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b56b89fb-3248-4ce5-93dc-3db5055cc5a7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158295 Jun 17 13:20:29.723971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1506/2920] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:29 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:30.583960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:30.584954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:30.595749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.596520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.597895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.598550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.648222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:30.648847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:30.655924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.656365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.657186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.657615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.731612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:30.736873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:30.742576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-51d2cffe-26a3-4ec2-84f1-936b2158da78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098454 Jun 17 13:20:30.743147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1507/2921] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:20:30.748026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:30.748618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:30.750406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:30.751928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:30.753143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-87461271-60b0-4919-8c44-ab8d9c52ef5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174697 Jun 17 13:20:30.753958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1415/2922] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:30.755102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.755589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.756360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.756782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.889245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:30.897645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9e587f4-4814-4e74-ba88-9684323f80dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153481 Jun 17 13:20:30.898219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1508/2923] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:30 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:31.760706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:31.761350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:31.769990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.770507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.771292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.771836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.773503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:31.774256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:31.781250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.781687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.782424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.782849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.838430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:31.846779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b6168f01-65fd-4198-bc4d-c31b5bb81ee6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090003 Jun 17 13:20:31.847724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1416/2924] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:31.914455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:31.915063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:31.915705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:31.921830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.922274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.923021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.923474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.923684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:31.925192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:31.926390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5ae60ffd-f91f-46c0-8ea9-259ba97fadfe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.157892 Jun 17 13:20:31.926955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1509/2925] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:31.942093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:32.061970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:32.072452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fe2203ab-993b-499b-bc54-76e4ee1a424b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161233 Jun 17 13:20:32.073028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1417/2926] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:31 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:32.864751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:32.867099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:32.874417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.874858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:32.875651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.876063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:32.941848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:32.945860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:32.946471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:32.950466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f0181bd0-42b9-40ce-a39f-ce844335dd32 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089654 Jun 17 13:20:32.951057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1510/2927] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:32.953619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.954075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:32.954839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.955273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:33.094455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:33.095563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:33.097399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:33.102725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.103501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:33.104364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.104797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:33.106433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:33.107986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:33.109130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-68f1dfcc-0bb7-4cf5-b0dd-55464b76ed63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167363 Jun 17 13:20:33.117088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1418/2928] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:33.239622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:33.248228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-811cb1e2-75fb-4b9c-9091-152afd145b49 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161121 Jun 17 13:20:33.248809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1511/2929] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:33 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:33.967897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:33.968545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:33.975701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.976147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:33.976917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.977349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.039957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:34.048030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-93f7f64f-afa3-41ae-84b0-ac2a3d43de73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084073 Jun 17 13:20:34.048596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1419/2930] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:34.128407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:34.129392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:34.136467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:34.136906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.137653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:34.138078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.156108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:34.266367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:34.266975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:34.273549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:34.274037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:34.274483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.275307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:34.275754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.282647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:34.284187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:34.285439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b656b5a8-eb8e-4fe4-b0e8-392f8f748a2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161082 Jun 17 13:20:34.286000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1512/2931] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:34.405623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:34.413936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-42886b6b-ff87-4329-b4f0-87569e6318b1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.151478 Jun 17 13:20:34.414511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1420/2932] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:34 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:35.065660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:35.066479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:35.068697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=80 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:35.074418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.074850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.075639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.076043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.146047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:35.154544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c9aa7c82-bd52-4ecd-b1d4-07011cd5e0e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092833 Jun 17 13:20:35.155114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1513/2933] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:35.304330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:35.304952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:35.312094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.312548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.313313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.313748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.432412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:35.433326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:35.440165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.440794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.441921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.442556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.456793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:35.466065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:35.467616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:35.468800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c4988115-0c30-46b3-a0b0-779857c952e6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168683 Jun 17 13:20:35.469362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1421/2934] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:35.582139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:35.590159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d6730602-aaa9-41bb-9166-3f4618c20ad6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163195 Jun 17 13:20:35.590734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1514/2935] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:35 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:20:36.172114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:36.172724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:36.179725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.180173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.180923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.181380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.250822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:36.260817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9176baf1-0d54-4aa0-9a3f-60a5a27abeb4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092765 Jun 17 13:20:36.261389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1422/2936] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:36.487791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:36.488451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:36.496231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.496682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.497457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.497891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.607836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:36.608594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:36.616663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.617188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.617969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.618418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.633030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:36.641593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:36.643058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:36.644579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8a46865a-856f-4bd3-9af1-56a844683606 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160536 Jun 17 13:20:36.645595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1515/2937] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:36.752514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:36.761692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7efaccac-da31-475e-bc12-7d97067e1e1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157904 Jun 17 13:20:36.762264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1423/2938] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:36 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:37.278454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:37.279062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:37.286222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.286669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.287426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.287879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.354069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:37.363123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-48bacc36-e2f9-4a0b-9bd5-c6397644b992 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088454 Jun 17 13:20:37.363716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1516/2939] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:37.663922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:37.664567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:37.671590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.672038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.672795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.673223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.780237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:37.781029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:37.789134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.789571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.790643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.791154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.814402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:37.824755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:37.826790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:37.829013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0966adfb-e843-4e67-9608-35ef2c37a06f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168808 Jun 17 13:20:37.830016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1424/2940] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:37.937513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:37.946007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2b7d0e8-1f7e-49ae-b8af-e6f1a7566de4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.170298 Jun 17 13:20:37.946581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1517/2941] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:37 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:38.380335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:38.380945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:38.387650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.388105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.388863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.389300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.452553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:38.461038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f3fd2477-4fc8-48cb-9aa3-3af5072bd850 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084689 Jun 17 13:20:38.461610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1425/2942] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:38.850935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:38.851591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:38.858653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.859100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.859904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.860341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.963663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:38.964345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:38.971516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.971976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.972797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.973246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:39.001204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:39.010353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:39.011895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:39.013060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1227634-916a-4e46-a295-dfbd4c0cc692 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166352 Jun 17 13:20:39.013633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1518/2943] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:39.109579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:39.119136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-06dcaf7c-7cd5-4664-85a3-55ad2ad3cc2c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159056 Jun 17 13:20:39.119747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1426/2944] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:38 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:39.478554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:39.479090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:39.485683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:39.486155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:39.486874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:39.487301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:39.549805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:39.558443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3b6ab349-73a9-4226-ad79-0a61783f5d8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083906 Jun 17 13:20:39.559011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1519/2945] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:40.032208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:40.032800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:40.040230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.040669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.041427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.041853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.136984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:40.137606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:40.144605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.145125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.145878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.146307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.178377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:40.187387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:40.188912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:40.190102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7afe2ba4-0b10-4569-ae4f-a6f29602fbdb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161986 Jun 17 13:20:40.190751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1427/2946] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:40.280185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:40.288942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e0cb7e18-c9b9-46a4-a818-e5aa007070a8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155647 Jun 17 13:20:40.289442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1520/2947] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:40 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:40.576804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:40.577318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:40.584131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.584574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.585330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.585755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.648961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:40.657186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4685714e-a5cd-444e-b8ab-c876ca2bd791 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084401 Jun 17 13:20:40.657755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1428/2948] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:41.208598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:41.209159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:41.216221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.216663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.217419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.217845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.306750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:41.307397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:41.314388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.314832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.315664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.316136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.359493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:41.369112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:41.370513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:41.371694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-63714917-b7aa-48c2-8c56-38964446004d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167399 Jun 17 13:20:41.372255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1521/2949] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:41.452342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:41.460933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-115766b7-c3cc-4a14-9955-e89b7c4d28fa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158505 Jun 17 13:20:41.461504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1429/2950] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:41 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:41.674267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:41.674786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:41.681740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.682192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.682984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.683424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.749687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:41.758278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7ca4937f-012b-41f0-b2a2-e095195da3c7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088135 Jun 17 13:20:41.758852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1522/2951] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:42.390312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:42.390895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:42.397980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.398426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.399187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.399731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.478551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:42.478946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:42.486653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.487108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.487962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.488497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.535254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:42.544233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:42.545688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:42.546849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-83bd9734-71be-4160-96f6-671ea3598b86 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160569 Jun 17 13:20:42.547657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1430/2952] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:42.624236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:42.633130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e9ade52a-76bf-4b5e-83ce-e441e5920ef4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158697 Jun 17 13:20:42.633679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1523/2953] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:42 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:42.775932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:42.776531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:42.783394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.783839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.784635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.785699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.851055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:42.859566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f04634cc-1964-45ab-88a0-2eb509ee70d0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087561 Jun 17 13:20:42.860149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1431/2954] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:43.566044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:43.566864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:43.573957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.574394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.575146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.575607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.650533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:43.651161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:43.653584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=80 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:43.659348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.659816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.660583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.661011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.714575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:43.724106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:43.725595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:43.726773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-498644ae-3ec3-4484-80df-2f04ccb4c6c7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165018 Jun 17 13:20:43.727331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1524/2955] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:43.799589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:43.808043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5c3863ec-7b91-4170-842b-c26d161dc9f3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161479 Jun 17 13:20:43.808616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1432/2956] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:43 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:43.877532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:43.878091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:43.884746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.885202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.885950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.886382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.947726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:43.955824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a69830b2-ef6f-496f-b850-c8c547cc4c6f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.082212 Jun 17 13:20:43.956416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1525/2957] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:44.745773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:44.746404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:44.753708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.754157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.754929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.755390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.826461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:44.827066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:44.833713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.834153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.835231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.835352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.889244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:44.898461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:44.900007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:44.901220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-81e21f74-67b7-4386-ac64-82fa759ef351 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159843 Jun 17 13:20:44.901756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1433/2958] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:44.967456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:44.973371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:44.973995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:44.976136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-75225f49-a3be-4859-88b9-378767e39c18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154079 Jun 17 13:20:44.984397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1526/2959] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:44 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:44.984616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.984616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.984616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.984616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.986141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:45.044739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:45.053256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9c9cebef-c771-4d8b-b8d0-5ecb3f85258d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084167 Jun 17 13:20:45.053809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1434/2960] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:45.922504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:45.923148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:45.930179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:45.930619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:45.931404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:45.931840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:45.996481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:45.997113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:46.008862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.009316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:46.010121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.010567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:46.085315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:46.093881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:46.095357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:46.096531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-522d7b36-4ce3-4054-87cf-82d737f9973c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178080 Jun 17 13:20:46.097178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1527/2961] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:46.101586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:46.102178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:46.108376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.108811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:46.109596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.114434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:46.148106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:46.156410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d6d856a2-f21d-4505-8311-d5739db141af tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166533 Jun 17 13:20:46.156990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1435/2962] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:45 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:46.178660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:46.186659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49756395-0c58-4929-833f-e77f37371b2b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088562 Jun 17 13:20:46.187212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1528/2963] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:47.115554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:47.116260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:47.123972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.124420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.125205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.125639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.174191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:47.174803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:47.181746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.182189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.182944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.183404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.187490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:47.261977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:47.270906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:47.272445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:47.273619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-80a3eae1-3cfb-47be-89cf-8e7df4877eba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162300 Jun 17 13:20:47.274182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1436/2964] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:47.278726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:47.279334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:47.285698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.286143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.286916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.287347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.319018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:47.327357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-80e57b96-784d-4215-b52c-58716aa55917 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157007 Jun 17 13:20:47.327972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1529/2965] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:47 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:47.350802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:47.359102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a47bf2fb-f801-4817-802e-ba3769931ee4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083948 Jun 17 13:20:47.359797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1437/2966] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:48.293030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:48.293662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:48.300992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.301362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.302136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.302568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.344780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:48.345440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:48.352715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.353160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.353928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.354356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.442047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:48.451423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:48.452954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:48.454225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d0137434-e6d1-4746-8d47-43634196c4a6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165273 Jun 17 13:20:48.454779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1530/2967] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:48.467788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:48.468657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:48.475316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.475925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.476711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.477140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.498540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:48.506958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-79b22638-047e-43d2-a716-6bb6d3ed6ebf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166040 Jun 17 13:20:48.507595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1438/2968] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:48 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:48.541763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:48.549997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-220ee22b-12d7-47ee-810e-68443a93a2aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094186 Jun 17 13:20:48.550600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1531/2969] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:49.473700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:49.474296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:49.481241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.481685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.482431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.482851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.524677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:49.525292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:49.532554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.533023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.533786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.534299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.620181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:49.629444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:49.630963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:49.632188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-91e7f317-966f-4533-92c0-c67de3996e2d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162905 Jun 17 13:20:49.632761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1439/2970] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:49.637362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:49.638002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:49.644347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.644763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.645564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.646004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.676366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:49.684656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2ef6e01e-56ad-458b-a3cd-1f074ec965c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163824 Jun 17 13:20:49.685241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1532/2971] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:49 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:49.711904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:49.720233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b77764ab-45ac-4d2b-b1bc-1e8002a46981 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086505 Jun 17 13:20:49.720797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1440/2972] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:50.650742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:50.651351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:50.661913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.662357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.663129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.663628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.702879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:50.703592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:50.711048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.711520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.712299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.712731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.802666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:50.811575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:50.813066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:50.814199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ab5b3c3d-16f9-4e04-9423-8b40a39645e5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167455 Jun 17 13:20:50.814798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1533/2973] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:50.819452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:50.820055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:50.826283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.826718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.827505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.827934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.852105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:50.860629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eb77012d-8b66-4c80-931d-a6cbb96b6110 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161574 Jun 17 13:20:50.861197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1441/2974] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:50 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:50.890848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:50.899353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ed5c1267-11de-48b2-876f-09b10f0ab372 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083582 Jun 17 13:20:50.899958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1534/2975] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:51.833749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:51.834492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:51.841919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.842397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.843176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.843647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.878244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:51.879109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:51.886377 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.886898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.887791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.888320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.976547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:51.985587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:51.987191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:51.988601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cc3b6f64-92e4-433a-9134-cb2289d35489 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159016 Jun 17 13:20:51.989232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1442/2976] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:51.994072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:51.994929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:52.001358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:52.001865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:52.002687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:52.003415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:52.024179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:52.032284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-15302e57-3760-43cd-aac3-48892fb5414e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157847 Jun 17 13:20:52.032833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1535/2977] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:51 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:52.074105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:52.083105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4e9d3eb4-ed69-4ad4-928d-3474f1c54d33 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092814 Jun 17 13:20:52.083694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1443/2978] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:53.008156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:53.008790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:53.015856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.016330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.017099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.017534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.050383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:53.051128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:53.058391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.058844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.059656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.060092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.161640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:53.170804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:53.172360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:53.173543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-057c499c-4a92-4739-ade1-db82651aae3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169386 Jun 17 13:20:53.174123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1536/2979] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:53.179093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:53.179738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:53.185890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.186345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.187113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.187578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.199857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:53.208585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6d03bd70-f359-43eb-92ea-f379000a7c3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162036 Jun 17 13:20:53.209171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1444/2980] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:53 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:53.251858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:53.260364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cc7afaf0-ba90-492a-b10d-487b95fc8231 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085127 Jun 17 13:20:53.260859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1537/2981] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:54.192521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:54.193124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:54.200137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.200573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.201328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.201751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.226297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:54.226926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:54.233677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.234127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.234892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.235326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.335083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:54.343923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:54.345456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:54.346756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0d88c9b4-e43c-40a6-b1bc-fe3c85db2668 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158297 Jun 17 13:20:54.347326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1445/2982] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:54.360839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:54.361452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:54.367862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.368673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.369442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.369873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.370897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:54.379202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2f053308-fc42-4c88-8d15-afed3f29190d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156710 Jun 17 13:20:54.380222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1538/2983] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:54 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:54.437716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:54.446234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6cccda19-52b5-4ebe-be6d-20e5278aaf5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097867 Jun 17 13:20:54.446831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1446/2984] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:55.365476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:55.366063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:55.373558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.373937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.374700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.375133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.396968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:55.398299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:55.405356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.405798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.406554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.406983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.511977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:55.521337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:55.522806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:55.524017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-61e7c655-68fa-4bcf-a940-1be1345eb01c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162766 Jun 17 13:20:55.535248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1539/2985] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:55.535248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:55.535248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:55.536102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.536535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.537321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.537747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.545237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:55.553639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-68cd56af-6ee2-4e26-b990-e957653b9c0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160892 Jun 17 13:20:55.554223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1447/2986] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:55 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:55.598730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:55.607011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71c39afe-d0e7-44f7-9079-dfc3e3d4cd3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.081286 Jun 17 13:20:55.607597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1540/2987] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:56.543232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:56.543839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:56.550873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.551323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.552136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.552564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.570277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:56.570905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:56.577837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.578280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.579046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.579506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.690171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:56.699276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:56.700874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:56.702052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f3aec5c2-3faa-44dd-bab1-cde6425eb4f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162822 Jun 17 13:20:56.702785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1448/2988] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:56.707750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:56.708420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:56.714988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.715455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.716220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.716650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.724430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:56.732553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30d3055a-615d-4a47-9958-12313e330695 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166119 Jun 17 13:20:56.733150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1541/2989] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:56 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:56.784018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:56.792165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e507fc7-f366-4b3f-9724-0c2db6266744 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088396 Jun 17 13:20:56.792733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1449/2990] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:57.721515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:57.722103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:57.729661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.730105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.730877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.731312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.750282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:57.750906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:57.758181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.758617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.759401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.759813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.864199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:57.874875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:57.876423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:57.877623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-448e529c-2900-437f-8edc-0c4e128531ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160242 Jun 17 13:20:57.888774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1542/2991] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:57.888774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:57.888774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:57.889508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.889957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.890742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.891173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.895903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:57.899531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:57.905424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a4c2c057-a998-400d-9c1c-be94195138ec tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159028 Jun 17 13:20:57.906105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1450/2992] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:57 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:20:57.953987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:57.962141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-35e03ac7-7b54-4866-91e0-6649439c4bfc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.082980 Jun 17 13:20:57.962712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1543/2993] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:58.897004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:58.897609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:58.904692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.905134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:58.905897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.906315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:58.922262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:58.922850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:58.930326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.930774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:58.931580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.932013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:59.039566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:59.048753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:59.050273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:59.051720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e984f7e9-e9ee-4e33-b77c-e83315e07e7d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158811 Jun 17 13:20:59.052327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1451/2994] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:20:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:59.056958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:59.057604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:59.063888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:59.064337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:59.065153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:59.065592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:59.072744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:59.081058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9421327c-162e-4f5a-942a-d37b0fa32006 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162685 Jun 17 13:20:59.081910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1544/2995] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:58 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:59.132738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:59.140854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f56e5e63-0292-4ee0-ac53-2dee904423a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087536 Jun 17 13:20:59.141407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1452/2996] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:00.070435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:00.071014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:00.078326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.078763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.079562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.079996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.099479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:00.100372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:00.107298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.107777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.108553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.108977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.264909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:00.275022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-788786bc-3465-4712-8cc2-78ca01ab7f2e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.180292 Jun 17 13:21:00.276061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1453/2997] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:00 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:00.280812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:00.281649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:00.289555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.289997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.290750 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.291143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.356632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:00.365081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e630135-5c37-4fe5-9fdd-d110cb402171 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087823 Jun 17 13:21:00.365665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1454/2998] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:00.376981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:00.380594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:00.386530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:00.388054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:00.389211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-320d7146-9a01-4a3f-b904-3792c14cbf7b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.322855 Jun 17 13:21:00.389767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1545/2999] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:01.293402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:01.294046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:01.301680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.302134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.302903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.303336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.382910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:01.383320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:01.390434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.390892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.391688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.392124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.442154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:01.450801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-41086176-c60a-47e3-9174-e165be28bcda tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161299 Jun 17 13:21:01.451951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1455/3000] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:01 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:01.456909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:01.457916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:01.461483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:01.464387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.464835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.465610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.466042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.469718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1fe6291f-c268-413d-9b0b-d12950b149a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091174 Jun 17 13:21:01.470315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1546/3001] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:01.596705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:01.606273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:01.607821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:01.608993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bf854117-3945-46a4-9973-59890075ae1e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.155993 Jun 17 13:21:01.609565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1456/3002] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:02.468951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:02.469570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:02.476646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.477091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.477857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.478287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.487436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:02.488117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:02.495407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.495877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.496651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.497089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.560256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:02.569190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b528d907-e104-4abc-a85c-ca8a91a2c5b6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085789 Jun 17 13:21:02.569776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1457/3003] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:02.611217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:02.619929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ea214723-6d53-4347-b8a8-f532c61e958a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154958 Jun 17 13:21:02.620496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1547/3004] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:02 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:02.628037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:02.628776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:02.635324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.635811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.636573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.637011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.779022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:02.790460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:02.792187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:02.793366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a104c1c6-d5a1-4285-b19d-bf38c27e09e3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169340 Jun 17 13:21:02.793934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1458/3005] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:03.586289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:03.586905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:03.593845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.594311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.595064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.595607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.642429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:03.643053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:03.650074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.650515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.651273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.651934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.666066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:03.678301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d325491a-24d2-4bc8-9156-45f1c832c999 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.095587 Jun 17 13:21:03.679785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1548/3006] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:03.790764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:03.799175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d3be632b-323c-4fdb-bdb8-4e247dfdbc25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162101 Jun 17 13:21:03.799790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1459/3007] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:03 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:03.812096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:03.812695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:03.818977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.819409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.820187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.820639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.956611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:03.965382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:03.966877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:03.968061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9dff0c13-a2e3-4685-be81-8ff6ad353724 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159889 Jun 17 13:21:03.968653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1549/3008] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:04.695931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:04.696577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:04.703712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.704149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.704905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.705328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.769741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:04.777948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3efb287a-df23-41da-8cca-1650dc99e290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085944 Jun 17 13:21:04.778516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1460/3009] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:04.817372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:04.817955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:04.824744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.825177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.825925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.826351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.960446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:04.969099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4188135-a354-4d7e-b787-0b2a543af7a2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155860 Jun 17 13:21:04.969694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1550/3010] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:04 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:04.986158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:04.986818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:04.993922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.994351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.995098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.995560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:05.132586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:05.141270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:05.142763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:05.143999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2ec54139-2a06-45f7-9288-4fd8e9ed491b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161862 Jun 17 13:21:05.144670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1461/3011] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:05.796032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:05.796656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:05.798610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=76 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:05.805028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.805465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:05.806222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.806649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:05.873471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:05.881997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8d748e6d-788b-4ccd-b262-c63fba8d5c42 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089796 Jun 17 13:21:05.882573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1551/3012] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:05.987364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:05.988097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:05.995396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.995871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:05.996637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.997073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.134795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:06.143412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-13499483-3981-4291-8b1d-d5af21f86198 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160301 Jun 17 13:21:06.143993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1462/3013] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:05 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:06.162580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:06.163178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:06.169704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:06.170145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.170898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:06.171317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.309247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:06.318363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:06.319866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:06.321010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5accf37e-27b2-461a-beac-74c82d74523f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162680 Jun 17 13:21:06.321565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1552/3014] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:06.899624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:06.900267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:06.906903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:06.907352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.908178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:06.908616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.971716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:06.980073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4f1050d3-1cdb-45b4-a1ab-bcfb9c9aa579 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084624 Jun 17 13:21:06.980641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1463/3015] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:07.160933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:07.161556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:07.168670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.169106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.169854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.170282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.304015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:07.312604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-72127368-960a-45cf-ac82-62b60b13f238 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155705 Jun 17 13:21:07.313176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1553/3016] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:07 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:07.339573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:07.340174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:07.346746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.347189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.347987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.348426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.484525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:07.495473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:07.496966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:07.498121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a80cf3c-9273-4fcd-9ea4-55513e1e1f16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162629 Jun 17 13:21:07.498674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1464/3017] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:07.998356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:07.998955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:08.005845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.006287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.007051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.007514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.070067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:08.078600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-53737c4e-d1a3-4072-8fac-d19bb76bf86d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084180 Jun 17 13:21:08.079167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1554/3018] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:08.332861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:08.332861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:08.341661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.342348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.342858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.343285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.482891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:08.491697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dc195ee1-9047-4ebd-990a-ad444a12cb9c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165093 Jun 17 13:21:08.492271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1465/3019] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:08 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:08.517078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:08.517681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:08.524750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.525197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.526000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.526436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.663969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:08.672756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:08.674265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:08.676107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be72554c-be89-4dd8-a949-9e358b10de19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163103 Jun 17 13:21:08.676656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1555/3020] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:09.097086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:09.097700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:09.104482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.104895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.105668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.106093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.176186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:09.184601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3c7e0d6-4595-457c-ad1d-c3507b246aa6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091920 Jun 17 13:21:09.185173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1466/3021] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:09.509310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:09.509917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:09.516467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.516911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.517664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.518342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.653134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:09.661638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cf891cc5-93ef-49ee-9dea-976ea0043413 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156317 Jun 17 13:21:09.662214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1556/3022] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:09 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:09.694439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:09.695004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:09.702121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.702571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.703335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.703803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.722462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:09.837019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:09.845914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:09.847739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:09.848903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a8ac7f1b-3512-4134-94e5-2696ee4125d7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158443 Jun 17 13:21:09.849461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1467/3023] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:10.201884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:10.202483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:10.209178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.209615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.210364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.210788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.273903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:10.282408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-229203a3-4a25-42ea-887d-eb0477202e65 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084415 Jun 17 13:21:10.282977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1557/3024] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:10.679794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:10.680396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:10.686871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.687307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.688091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.688515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.819660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:10.828156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e5320876-6ea9-4282-8430-fc7d20a081b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.152315 Jun 17 13:21:10.828731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1468/3025] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:10 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:10.868088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:10.868672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:10.875715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.876158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.876915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.877434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.009658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:11.018668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:11.020181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:11.021357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d2b0348a-2fb2-473e-8b59-66108a0377e0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.157662 Jun 17 13:21:11.021881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1558/3026] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:11.299802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:11.300523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:11.307228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.307694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.308460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.308883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.378263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:11.386886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8fda68cd-3327-4f12-97fd-a50498418a88 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091066 Jun 17 13:21:11.387471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1469/3027] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:11.848939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:11.849685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:11.857161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.857684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.858562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.859064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.008209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:12.019425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-942ef674-f242-41db-83d0-ff9417252781 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.176318 Jun 17 13:21:12.019981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1559/3028] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:11 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:12.039568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:12.040174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:12.047046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.047522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.048268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.048701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.208751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:12.221087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:12.223547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:12.225304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1938ddef-4083-43db-b27c-602f5b47a0c9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.189408 Jun 17 13:21:12.226039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1470/3029] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:12.405345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:12.405850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:12.413952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.414362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.415154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.415598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.491197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:12.500098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-feda4923-6af8-4e5f-99da-0e8c8ea086c9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098885 Jun 17 13:21:12.500636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1560/3030] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:13.041485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:13.042368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:13.053578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.054327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.055584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.056333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.196011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:13.209146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-80cc944d-54c3-48b8-9d71-bcc4af26925a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.174226 Jun 17 13:21:13.209996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1471/3031] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:13 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:13.249530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:13.250112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:13.257329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.257770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.258519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.258952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.405180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:13.417303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:13.419665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:13.421403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-662e7568-312a-4955-ac0c-6b82ca53176d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.175593 Jun 17 13:21:13.422144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1561/3032] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:13.518899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:13.519544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:13.526266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.526699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.527490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.527915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.594180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:13.603399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1bb56545-26e9-4275-82f9-0df2d0dbfaeb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089292 Jun 17 13:21:13.603926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1472/3033] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:14.231819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:14.232407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:14.239212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.239700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.240461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.240888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.259162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:14.373884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:14.382363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-20e99701-c259-4c3e-a370-e46451ac2ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154454 Jun 17 13:21:14.382944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1562/3034] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:14 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:14.445032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:14.445981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:14.449671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=82 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:14.458142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.458583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.459362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.459819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.603294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:14.615091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:14.616669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:14.618354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fb87d880-4fa2-45b7-9b1f-f38207a3fb76 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.180029 Jun 17 13:21:14.618910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1473/3035] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:14.622648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:14.623414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:14.630356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.630798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.631581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.632044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.698679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:14.707525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a67794cb-9ab4-4fff-9779-f2bcae63183b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088582 Jun 17 13:21:14.708101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1563/3036] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:15.403486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:15.404354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:15.413476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.413938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.414699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.415128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.554846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:15.563391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47c9b898-ccf7-4e87-873c-c64845735e8c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166481 Jun 17 13:21:15.564000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1474/3037] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:15 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:15.636589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:15.637222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:15.644299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.644844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.645611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.646041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.725747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:15.726393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:15.733676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.734169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.735204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.735670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.789252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:15.797988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:15.799485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:15.800605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe9ec0a2-f5aa-4ee4-81a3-85904294a53f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168015 Jun 17 13:21:15.801814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1564/3038] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:15.803496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:15.811948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4438f230-99ce-41aa-a109-5869d9c23b8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090778 Jun 17 13:21:15.812752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1475/3039] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:16.581322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:16.581930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:16.588918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.589360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.590114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.590565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.724063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:16.732441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6e0b1007-49fe-475e-bc03-4af30e7f1ace tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155048 Jun 17 13:21:16.733007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1565/3040] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:16 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:16.820178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:16.820773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:16.827813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.828234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.828973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.829402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.834249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:16.834795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:16.841211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.841666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.842430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.842853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.907602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:16.915787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1f645a7-d951-44b1-b6de-4fd2798fd575 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085435 Jun 17 13:21:16.916570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1566/3041] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:16.961269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:16.970091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:16.971646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:16.972807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-93895f28-a195-4de0-83f0-37ebecaa6993 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.157079 Jun 17 13:21:16.973451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1476/3042] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:17.749872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:17.750501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:17.757420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.757847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.758594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.759010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.891615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:17.899707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-23b0eeae-cc52-4237-ad34-1a6df096fd09 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153754 Jun 17 13:21:17.900276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1567/3043] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:17 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:17.932502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:17.933084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:17.940188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.940637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.941425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.941850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.991784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:17.992731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:17.999061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.999732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:18.000521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:18.000882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:18.004456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:18.013536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c89811b1-58d1-4f27-9bba-04c89d5c2e71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084852 Jun 17 13:21:18.014090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1477/3044] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:18.137198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:18.146145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:18.147674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:18.148834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6864c632-b0ca-4dd4-809f-728310976c13 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161212 Jun 17 13:21:18.149425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1568/3045] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:18.917292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:18.917902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:18.924603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:18.925048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:18.925797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:18.926222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.032862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:19.033471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:19.040601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:19.041055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.041827 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:19.042261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.062055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:19.070512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1ede1227-4ae8-47f2-ac38-a75f34c10aa6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157129 Jun 17 13:21:19.071109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1478/3046] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:18 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:19.108178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:19.117736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5b52a0e3-ba9d-4068-9a55-96be58c5a64b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088454 Jun 17 13:21:19.118357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1569/3047] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:19.167616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:19.168145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:19.174817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:19.175263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.176053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:19.176496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.473974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:19.482729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:19.484253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:19.485410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c4c68126-9194-4ad8-819a-c4d8ebbc89ca tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.321915 Jun 17 13:21:19.485974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1479/3048] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:20.088144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:20.088761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:20.095761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.096207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.096961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.097650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.134484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:20.135073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:20.141976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.142415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.143175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.143630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.211244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:20.219755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d1ac5520-de71-4fbb-b620-21988026cc5e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089228 Jun 17 13:21:20.220317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1480/3049] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:20.229537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:20.237685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a6a43605-d157-4b63-acdc-23d924adc945 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153516 Jun 17 13:21:20.238247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1570/3050] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:20 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:20.508084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:20.508868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:20.516811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.517357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.518287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.518815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.662915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:20.671650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:20.673170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:20.674360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2dc886f5-77ac-49bc-9861-90eca322be2a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172410 Jun 17 13:21:20.674916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1481/3051] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:21.238469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:21.239135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:21.247232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.247692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.248442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.248881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.256232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:21.256851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:21.263906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.264340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.265105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.265527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.312771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:21.321361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fc86242a-0129-48ee-a58d-8666e6c2ad52 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086838 Jun 17 13:21:21.321929 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1571/3052] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:21.397956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:21.406250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7194a25e-ab36-46a7-bee1-02d4db0ba5e8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154061 Jun 17 13:21:21.406811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1482/3053] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:21 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:21.693541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:21.694036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:21.700578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.701020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.701771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.702206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.843546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:21.853184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:21.854669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:21.855845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a3ce244e-36fc-41da-b581-158155c5a50f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166632 Jun 17 13:21:21.856395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1572/3054] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:22.338670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:22.339256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:22.346392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.346832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.347626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.348049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.413399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:22.421992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f23bf75-01a6-4a6d-92f7-43978f5c3b36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087312 Jun 17 13:21:22.422539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1483/3055] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:22.423662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:22.424273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:22.431460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.431899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.432658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.433077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.569763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:22.578315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a867cfe7-6b0d-4842-8ae7-3dd021403d17 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158501 Jun 17 13:21:22.578891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1573/3056] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:22 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:22.875414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:22.876026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:22.883080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.883904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.884675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.885123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.891740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:23.038039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:23.047602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:23.049160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:23.050375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4c697165-0224-48e9-b079-b8b574829830 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178930 Jun 17 13:21:23.050934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1484/3057] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:23.441969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:23.443093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:23.452048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.452500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.453275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.453714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.522126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:23.530435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-20f10189-0d4c-4ddf-95fe-b980b0d896ec tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094060 Jun 17 13:21:23.531004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1574/3058] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:23.596477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:23.597296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:23.605648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.606118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.606900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.607328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.767694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:23.779831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5e1461d2-b187-486f-9759-e15f692ae534 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.186975 Jun 17 13:21:23.780660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1485/3059] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:23 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:24.068908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:24.069796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:24.076627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.077063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.077824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.078250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.225764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:24.235310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:24.236872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:24.238038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9caeb988-7b8b-422e-ae27-a2e3aced5e19 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173152 Jun 17 13:21:24.238588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1575/3060] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:24.548960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:24.549617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:24.558189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.558626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.559392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.559826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.628659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:24.637440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ea53d86d-b43f-4b69-b6f4-f452d590b0a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092490 Jun 17 13:21:24.638317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1486/3061] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:24.800006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:24.800586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:24.807349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.807825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.808579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.809003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.942763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:24.951217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b979a41a-82c3-4234-881a-26fa73e9ccfe tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155190 Jun 17 13:21:24.951838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1576/3062] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:24 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:25.259169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:25.259818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:25.266632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.267083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:25.267899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.268333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:25.419274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:25.428852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:25.430361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:25.431565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c13ddbec-24f1-49de-8e93-30373df2e23d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176453 Jun 17 13:21:25.432122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1487/3063] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:25.655753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:25.656368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:25.664819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.665367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:25.666539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.667076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:25.740693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:25.749685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c4248e26-9e3f-4981-8dae-f1868d2c3898 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098028 Jun 17 13:21:25.750268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1577/3064] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:25.971019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:25.971688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:25.979493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.979930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:25.980701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.981137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.127083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:26.135623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a0bf7f43-1e4a-4033-a835-6a7604061fb7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.170473 Jun 17 13:21:26.136209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1488/3065] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:25 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:26.451479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:26.452128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:26.459398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.459871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.460631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.461061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.613727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:26.623807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:26.625296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:26.626448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9fd4ae39-b2a9-4dc3-a166-985c3982c93a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.179294 Jun 17 13:21:26.627004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1578/3066] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:26 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:26.767577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:26.768205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:26.775827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.776276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.777059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.777496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.849828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:26.858108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70ad94c4-5ec1-4057-a807-716c3db2a5d7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094980 Jun 17 13:21:26.858684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1489/3067] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:27.155850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:27.156828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:27.166106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.167026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.167272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.167811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.172155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:27.314481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:27.323066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5dcacdf0-ea3e-47ec-b12a-206e2c4a863e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.174027 Jun 17 13:21:27.323926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1579/3068] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:27 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:27.645689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:27.646321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:27.654401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.655525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.655704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.656133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.792184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:27.801743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:27.803218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:27.804395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cc1d68e1-4603-4044-a98c-f42e57bfdd02 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162770 Jun 17 13:21:27.804921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1490/3069] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:27.879579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:27.880206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:27.888460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.888901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.889655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.890207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.958164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:27.967078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9ea23fd7-8f24-410d-89b0-ab316b2399a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093415 Jun 17 13:21:27.967720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1580/3070] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:28.340928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:28.341437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:28.348026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.348489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.349290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.349723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.482377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:28.490985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f654884-2e7b-40e7-aaad-dac18bd62ff2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154238 Jun 17 13:21:28.491587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1491/3071] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:28 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:28.823343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:28.824596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:28.831904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.832352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.833141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.833578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.984181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:28.985609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:28.986233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:28.995031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:28.995360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.996036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.996932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:28.997195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.997694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.998267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a0e784ae-cd5f-45e8-9aca-e49264e805c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178918 Jun 17 13:21:28.998871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1581/3072] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:29.073036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:29.082743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a0cbbb2b-6aba-45f5-b793-6d95974dbc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.100883 Jun 17 13:21:29.083287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1492/3073] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:29.510285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:29.510924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:29.517584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:29.518029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:29.518777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:29.519206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:29.656482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:29.665832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f7308864-4541-440b-8e3b-fff5c1669696 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159410 Jun 17 13:21:29.666411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1582/3074] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:29 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:30.020651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:30.021276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:30.032139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.032835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.034072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.034757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.102046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:30.102046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:30.109073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.109998 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.110851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.111724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.176905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:30.182573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:30.187115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:30.188625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:30.189803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-10b76518-4042-4f74-ab75-5ac17452d5b0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174876 Jun 17 13:21:30.190353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1493/3075] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:30.190928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e625705f-eb4c-4290-be32-23eb91b44ca4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093572 Jun 17 13:21:30.191562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1583/3076] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:30.684391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:30.685133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:30.691780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.692243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.694388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.694388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.830525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:30.838537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff37ebc4-16f4-4ab3-8807-561a5bc59e0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158587 Jun 17 13:21:30.839112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1494/3077] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:30 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:31.208853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:31.209435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:31.209970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:31.210156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:31.217785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.218157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.218286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.218617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.218944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.219390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.219506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.219864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.289135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:31.300424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7668a4be-c061-48ed-8806-4ed416d76faf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094829 Jun 17 13:21:31.300424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1584/3078] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:31.360678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:31.371844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:31.373265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:31.375117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-09640be0-ae53-4b1d-8d83-0d47bc20ec3d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169767 Jun 17 13:21:31.376062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1495/3079] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:31.857079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:31.857678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:31.864459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.864922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.865669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.866095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.000435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:32.008912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f30566c6-4108-4813-b93e-e57fed31b3f9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156537 Jun 17 13:21:32.009492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1585/3080] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:31 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:32.317382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:32.318116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:32.325400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:32.325857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.326624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:32.327057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.394196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:32.398451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:32.399126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:32.404033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cc9356d0-6428-48be-a1d7-5d51ee3e6fb0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090523 Jun 17 13:21:32.404642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1496/3081] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:32.407510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:32.407943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.408700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:32.409120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.554993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:32.564987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:32.567289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:32.569058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a9adca56-1e30-4678-8ee4-acc500e2eee9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174640 Jun 17 13:21:32.569629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1586/3082] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:21:33.026427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:33.027039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:33.034606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.035047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.035841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.036263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.169559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:33.178122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e8365057-2478-470d-954e-993f8a10af04 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155570 Jun 17 13:21:33.178690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1497/3083] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:33 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:33.424736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:33.425335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:33.432530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.432968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.433748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.434184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.513512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:33.522645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5d7e8fe4-7d86-449b-948e-befeb0106c23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.101861 Jun 17 13:21:33.523243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1587/3084] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:33.592046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:33.592737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:33.602817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.603482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.604984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.605658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.756344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:33.765302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:33.766813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:33.768024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f8d84e16-f2e8-4a51-b305-bff35d545884 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.182180 Jun 17 13:21:33.768582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1498/3085] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:34.196232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:34.196840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:34.203578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.204002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.204770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.205203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.345953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:34.355945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-39c7eb40-b7fe-49c0-b739-fb7f6412f326 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163743 Jun 17 13:21:34.356625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1588/3086] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:34 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:34.540976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:34.541657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:34.549910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.550355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.551090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.551592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.617968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:34.626384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-155b734a-88b3-4765-9446-3801d76a59c2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089643 Jun 17 13:21:34.626955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1499/3087] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:34.787020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:34.787677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:34.794975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.795442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.796213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.796631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.936662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:34.949512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:34.951014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:34.952208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-61157d43-b2d1-4ac9-a93d-1b364af55517 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169241 Jun 17 13:21:34.952748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1589/3088] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:35.375897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:35.376828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:35.384567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.385258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.386103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.386809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.530930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:35.534453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:35.540465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6616260-6901-4979-9df8-4eb56bc4e2c8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.169401 Jun 17 13:21:35.541260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1500/3089] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:35 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:35.645502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:35.646012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:35.652892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.653340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.654101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.654535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.719774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:35.729180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8ded6460-531f-4a0c-af37-a9d51cde6fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087715 Jun 17 13:21:35.729732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1590/3090] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:35.975421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:35.976305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:35.985198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.985643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.986402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.986833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.122422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:36.131408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:36.132962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:36.134114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e311effe-8623-41d3-a8f1-ab10240b727e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165638 Jun 17 13:21:36.134869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1501/3091] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:36.558849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:36.560054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:36.562082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=80 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:36.568917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.569358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.570126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.570543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.709808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:36.718432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3e35e093-e8ea-417f-970d-c57d14d0a9ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163741 Jun 17 13:21:36.719020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1591/3092] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:36 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:36.747511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:36.748113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:36.755560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.756118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.756916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.757496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.828565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:36.836983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4b28edd1-9aef-4fc7-bd02-4c0a1ac4b917 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093871 Jun 17 13:21:36.837552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1502/3093] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:37.153371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:37.154032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:37.160746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.161218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.162004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.162434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.542424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:37.551173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:37.552699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:37.553853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-df3aee57-2b9a-4879-b08f-b38e9222d407 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.404988 Jun 17 13:21:37.554411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1592/3094] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:37.736362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:37.736947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:37.743788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.744236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.744996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.745426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.854415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:37.855031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:37.864148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.864595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.865364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.865796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.938181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:37.947023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-55ce05c1-1efd-452c-8b08-e1966c1ebdbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096537 Jun 17 13:21:37.947654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1593/3095] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:38.133114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:38.143704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c037b60d-08fc-42c5-8646-928c9497bd1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.411242 Jun 17 13:21:38.144280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1503/3096] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:37 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:38.574904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:38.575915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:38.583000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:38.583465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:38.584219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:38.584642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:38.720932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:38.729874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:38.731626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:38.732807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f2a4755a-bb6e-431a-9672-5c4c15e29316 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163950 Jun 17 13:21:38.733367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1594/3097] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:38.965097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:38.965692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:38.972814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:38.973257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:38.974090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:38.974523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.040029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:39.048540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7b88b0a5-58b6-42f0-bf44-8eac3418eb45 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087530 Jun 17 13:21:39.049131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1504/3098] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:39.161450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:39.162094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:39.169347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.169769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.170570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.170995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.314999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:39.318670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:39.323906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ab4d01fb-bdb5-4bda-aa11-c2dfc5354b25 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166298 Jun 17 13:21:39.324492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1595/3099] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:39 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:39.754010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:39.754852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:39.764747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.765339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.766445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.766989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.910314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:39.918839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:39.920347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:39.921542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9102edd1-ddd4-478a-b7cc-3109a9a43e57 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173512 Jun 17 13:21:39.922126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1505/3100] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:40.068145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:40.068771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:40.076652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.077153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.078051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.078531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.146502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:40.154973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-af65584a-729b-43f8-a2f8-d50a4d216893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092606 Jun 17 13:21:40.155569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1596/3101] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:40.343850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:40.344612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:40.355723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.356462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.357761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.358200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.380792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:21:40.385339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:21:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af (ip 10.222.0.87) !!! Jun 17 13:21:40.495503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:40.504088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3dff8131-beb8-4633-9376-2011a252ad55 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165343 Jun 17 13:21:40.504656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1506/3102] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:40 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:40.941742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:40.942505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:40.951678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.952269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.953266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.953703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.109185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:41.121390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:41.123576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:41.125622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-195228a9-3e8a-486f-83fd-3699449d50e2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.188782 Jun 17 13:21:41.126560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1597/3103] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:41.172757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:41.173379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:41.179904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.180351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.181081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.181520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.248099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:41.256328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-98ca0d1c-5b31-4ddd-9bbb-970b1f5daab3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087736 Jun 17 13:21:41.256890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1507/3104] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:41.522092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:41.522620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:41.529166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.529612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.530365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.530796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.663923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:41.674099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0570da9f-c54e-449c-a327-02c820fe5168 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155924 Jun 17 13:21:41.674690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1598/3105] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:41 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:42.150089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:42.150669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:42.157684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.158132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.158927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.159361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.273657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:42.274313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:42.281264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.281746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.282508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.282944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.299747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:42.308912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:42.310429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:42.311656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f4a1aa8-b041-4957-b882-ba886457d88e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165709 Jun 17 13:21:42.312244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1508/3106] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:42.347318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:42.355617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1d7f3e61-1a9f-41da-a338-bac47180f4cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085978 Jun 17 13:21:42.356160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1599/3107] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:42.695960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:42.696790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:42.703470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.703932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.704698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.705261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.853829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:42.861924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b6bb582f-aba7-493a-a700-c5bfd7e7cbef tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.174024 Jun 17 13:21:42.862490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1509/3108] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:42 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:43.334474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:43.335599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:43.343916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.344373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.345172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.345621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.373559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:43.374114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:43.380827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.381279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.382037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.382473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.448252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:43.456790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0e8f456f-f7c0-42ed-8ade-8e6681d9bdae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087202 Jun 17 13:21:43.457386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1510/3109] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:43.494020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:43.502698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:43.504305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:43.505488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4eac1502-5835-4644-85b0-f78d131879f4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178275 Jun 17 13:21:43.506048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1600/3110] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:21:43.882263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:43.883150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:43.890980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.891462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.892560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.892994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.034772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:44.048651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e9c7be31-40f4-4db1-9f61-49ed57ce791e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171553 Jun 17 13:21:44.049508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1511/3111] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:43 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:44.057129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:21:44.057311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:21:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:21:44.474883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:44.475632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:44.483738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.484285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.485069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.485689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.524337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:44.525009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:44.527683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=78 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:44.534870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.535318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.536125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.536558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.553386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:44.562788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-07759be8-181f-4653-9d22-a92ccada67d6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092265 Jun 17 13:21:44.563451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1601/3112] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:44.678597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:44.688431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:44.689941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:44.691135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff304bb4-ae1f-4c2b-b77b-e00520ffb904 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171029 Jun 17 13:21:44.691751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1512/3113] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:21:45.071317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:45.071984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:45.079139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.079619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.080380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.080816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.214574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:45.223268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ad3466f-2b0f-4025-bbee-307e6471a2b0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156627 Jun 17 13:21:45.223866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1602/3114] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:45 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:45.582756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:45.583622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:45.591252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.591794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.592607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.593124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.663206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:45.672310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eb849cdf-bf17-49ce-99d3-510e2667192a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094785 Jun 17 13:21:45.672940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1513/3115] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:45.714148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:45.715020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:45.723802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.724256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.724999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.725428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.875831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:45.888080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:45.890634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:45.893583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6046e75e-5384-404e-9c77-7748100e6a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.184219 Jun 17 13:21:45.894558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1603/3116] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:46.241276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:46.242144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:46.248552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.248996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.249752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.250181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.397055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:46.410057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b8b2eaf6-9b94-4709-8a3b-16d89bcea0ca tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.172729 Jun 17 13:21:46.410960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1514/3117] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:46 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:46.693013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:46.693664 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:46.699928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.700381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.701138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.701573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.773772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:46.787917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43c38445-3201-4232-890c-71e7380346fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.100522 Jun 17 13:21:46.788871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1604/3118] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:46.919143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:46.919861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:46.927511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.927999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.928834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.929343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.081620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:47.090964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:47.092500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:47.093656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-921aaa80-fc7e-4981-9225-e4fca698ee98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.179203 Jun 17 13:21:47.094215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1515/3119] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:47.437165 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:47.437871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:47.445058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:47.445506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.446265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:47.446723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.587779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:47.596435 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5e75a3f7-87f0-4d0b-bf7a-2790b964cf3f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165505 Jun 17 13:21:47.597026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1605/3120] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:47 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:47.815422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:47.816235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:47.823582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:47.824026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.824780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:47.825207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.891124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:47.902996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9e5938d0-2261-42d5-a67e-428c557930fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094095 Jun 17 13:21:47.903887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1516/3121] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:48.113515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:48.114105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:48.122310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.122764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.123627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.124115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.287265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:48.302634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:48.312448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:48.313695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43375522-ccab-4a42-a350-6fd58d6ecea2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.204686 Jun 17 13:21:48.314277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1606/3122] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:48.615943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:48.617003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:48.624935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.625452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.626334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.626834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.646264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:48.778676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:48.790659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c0d7a9d8-3333-4742-a73c-9108d4f840f1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.179195 Jun 17 13:21:48.791223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1517/3123] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:48 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:48.927224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:48.928030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:48.935645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.936089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.936848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.937276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.002440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:49.010859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a49c23de-0349-4717-b7e8-deadd51b2efd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089086 Jun 17 13:21:49.011455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1607/3124] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:49.338702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:49.339395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:49.346103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.346550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.347307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.347766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.488618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:49.497577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:49.499082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:49.500277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cfa343be-fbbd-4473-8b5d-ea6ea782b461 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165694 Jun 17 13:21:49.500869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1518/3125] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:49.809526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:49.810172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:49.817456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.817899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.818665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.819094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.965700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:49.974114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d6c49b3c-8b4f-4c5d-8ba6-98e8e6e22961 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.169652 Jun 17 13:21:49.974681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1608/3126] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:49 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:50.028050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:50.028653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:50.035888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.036335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.037093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.037528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.103312 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:50.118685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a7f8e939-a500-4206-976f-bff2ba55842f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093943 Jun 17 13:21:50.123411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1519/3127] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:50.520351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:50.520955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:50.527146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.527698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.528574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.529000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.675483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:50.684574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:50.686168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:50.687229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f88a3ebf-b519-4f37-aa66-920dcde5065b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170836 Jun 17 13:21:50.687827 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1609/3128] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:50.995913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:50.996922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:51.004790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.005237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.005991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.006423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.137441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:51.138129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:51.145159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.145605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.146372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.146812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.155682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:51.164249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d44ec91a-c262-4906-b9a7-8a301390825b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.175167 Jun 17 13:21:51.164903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1520/3129] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:50 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:51.210774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:51.219109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ad46410-3967-499a-a9dd-962504ccca7d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085453 Jun 17 13:21:51.219739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1610/3130] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:51.714768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:51.715485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:51.723172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.723710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.724575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.725033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.861709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:51.874420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:51.876720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:51.877929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e3197422-028c-4dbf-a748-30d5150a8dde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167736 Jun 17 13:21:51.878486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1521/3131] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:52.183543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:52.184425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:52.194829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.195628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.196961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.197683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.241132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:52.242586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:52.253146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.253614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.254381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.254806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.323276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:52.331419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-05e3b6d6-0bb2-4bce-9b58-4d8ef9835d26 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099181 Jun 17 13:21:52.331977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1522/3132] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:52.355810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:52.364255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-39e8436b-5e82-4ed7-a26d-f67c096f36d5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.186024 Jun 17 13:21:52.364828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1611/3133] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:52 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:52.897137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:52.897767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:52.904281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.904746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.905553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.905998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.059621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:53.069960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:53.071736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:53.073154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e9f72b98-1a5f-4caf-b13a-2787aadb0d67 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.180218 Jun 17 13:21:53.073795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1523/3134] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:53.350694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:53.351330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:53.358620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:53.359065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.359824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:53.360253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.379482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:53.382491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:53.383107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:53.389929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:53.390380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.391141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:53.391605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.427965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:53.436533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a292afd-c3fb-45d0-b0c3-03720a8c1c36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091303 Jun 17 13:21:53.437308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1612/3135] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:53.541522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:53.551764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d2478871-46a0-4b12-b302-c4e06c6255c0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173322 Jun 17 13:21:53.552613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1524/3136] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:53 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:54.093063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:54.093698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:54.100861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.101303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.102058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.102486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.244208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:54.256728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:54.258290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:54.259491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2e3f774e-4b8f-413b-b270-b326097bfd2c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170417 Jun 17 13:21:54.260054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1613/3137] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:54.454662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:54.455266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:54.462746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.463258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.464086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.464516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.535934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:54.549197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5355c369-6d17-48b9-98b5-4d3664b56293 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098386 Jun 17 13:21:54.550006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1525/3138] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:54.572468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:54.573060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:54.579805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.580260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.581023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.581454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.744508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:54.757304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fa22ccad-c446-421c-9889-e89eaebfe111 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.189383 Jun 17 13:21:54.757868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1614/3139] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:54 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:55.287166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:55.288443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:55.298192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.298862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.299816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.300247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.460476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:55.476470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:55.478066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:55.479303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1c68b773-5685-4136-a882-2d765f833d50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.198548 Jun 17 13:21:55.479926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1526/3140] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:55.568199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:55.568849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:55.576774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.577468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.577987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.578430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.644695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:55.654162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-204058ee-81ef-407b-8e1a-d75f1105ea21 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089903 Jun 17 13:21:55.654683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1615/3141] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:55.783036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:55.784080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:55.794663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.795443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.796658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.797339 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.951333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:55.962948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a386f43f-087d-4838-bcc7-4bfeda4e8282 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.186437 Jun 17 13:21:55.963541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1527/3142] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:55 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:56.506235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:56.507082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:56.518789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.519724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:56.521225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.521981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:56.670341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:56.675552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:56.676384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:56.679638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:56.682131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:56.683263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5aac40a3-914c-43c6-94cc-c8e19f07f3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.183265 Jun 17 13:21:56.684671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1616/3143] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:56.685999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.686332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:56.687422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.688085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:56.770318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:56.779237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-218b4ef1-2e1d-4c49-9764-1f572d6bf0df tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.107493 Jun 17 13:21:56.779876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1528/3144] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:56.981509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:56.982124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:56.988672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.989117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:56.989875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.990307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.155815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:57.169632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e5bf7c05-293d-4c13-b8b4-75ace6bebbaa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.192304 Jun 17 13:21:57.170598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1617/3145] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:56 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:57.704488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:57.705488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:57.712778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.713225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.713976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.714404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.800501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:57.801151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:57.808540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.809615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.810420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.810855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.850648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:57.860451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:57.862010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:57.863234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-95631bee-da5f-4864-8311-0bca9e832c0e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162882 Jun 17 13:21:57.863831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1529/3146] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:57.876146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:57.884918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-212c6403-ea9b-41c7-924f-e73a19f7cc38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088492 Jun 17 13:21:57.885478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1618/3147] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:58.192437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:58.193111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:58.200163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.200660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.201448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.201882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.352635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:58.362166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c5dd25dd-cea7-49fb-b3dc-93c97573cb70 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173882 Jun 17 13:21:58.362729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1530/3148] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:58 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:58.882606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:58.883194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:58.890527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.891782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.892626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.893059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.902409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:58.903064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:58.911142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.911819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.912620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.913079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.981279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:58.990308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3ce8b3db-9794-4734-b50c-8a3f0ecd5bc7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091893 Jun 17 13:21:58.990875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1531/3149] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:59.028069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:59.037600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:59.039135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:59.040369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ddc28fd1-3098-428d-be88-96b617006791 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162002 Jun 17 13:21:59.040994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1619/3150] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:21:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:21:59.386269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:59.386875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:59.393216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:59.393665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:59.394531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:59.394961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:59.543805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:59.554755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aaa796b4-ed7a-4626-a6fd-cf21dadfac1e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.172294 Jun 17 13:21:59.555347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1532/3151] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:59 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:00.012029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:00.012720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:00.021519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.022156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.023335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.024051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.059872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:00.060445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:00.067591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.068044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.068811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.069245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.091004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:00.099248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-63ee4aba-8d1c-4b96-9b97-94ee86c165e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093366 Jun 17 13:22:00.099845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1620/3152] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:00.211735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:00.225143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:00.227301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:00.228512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a419a5ca-e822-4a21-bf5b-8274d4139f27 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173075 Jun 17 13:22:00.229070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1533/3153] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:22:00.429352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:22:00.429558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:22:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:22:00.577856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:00.578582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:00.585748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.586272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.587213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.587676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.740935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:00.749569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-df721b32-675a-4e19-a06d-3c411e0fb295 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.175927 Jun 17 13:22:00.750134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1621/3154] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:00 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:01.118844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:01.120161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:01.130171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.130907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.132281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.132995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.138675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:01.214377 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:01.226695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-58a21fc9-7d3d-4949-a197-5953113309bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.112932 Jun 17 13:22:01.227531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1534/3155] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:01.249086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:01.249682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:01.256470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.256922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.257681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.258118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.408246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:01.419868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:01.421828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:01.423551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1be6bf9b-971c-4676-ad56-a030a2da5182 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178423 Jun 17 13:22:01.424265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1622/3156] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:01.770662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:01.771387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:01.780868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.781274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.784473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.784914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.919748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:01.927875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5fc36af3-0be8-4913-b8e4-c41526cdba3c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164777 Jun 17 13:22:01.928478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1535/3157] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:01 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:02.248357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:02.249011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:02.255729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.256355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.256925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.257352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.332300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:02.345436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-053c7af4-e852-47d3-b326-cea79499b35e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.102576 Jun 17 13:22:02.346310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1623/3158] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:02.443205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:02.443925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:02.451693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.452251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.453092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.453625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.608806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:02.617950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:02.619472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:02.620635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f9080e2d-cc27-4623-894f-cd6db613fb3f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.182075 Jun 17 13:22:02.621187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1536/3159] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:02.945590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:02.946081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:02.952813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.953258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.953997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.954417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:03.093982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:03.107108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6a1954bb-60fd-43d9-8168-da68841ab125 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165338 Jun 17 13:22:03.107910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1624/3160] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:02 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:03.368583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:03.369196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:03.375836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:03.376283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:03.377038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:03.377469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:03.452753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:03.463347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b504ef0e-bf03-41e2-b266-228f5f3cdf1f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098977 Jun 17 13:22:03.463963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1537/3161] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:03.638613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:03.639261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:03.646357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:03.646805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:03.647617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:03.648050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:03.798843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:03.807420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:03.808945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:03.810111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5e4b39b8-4474-4bf4-a1f4-8f25760dc53c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.175660 Jun 17 13:22:03.810731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1625/3162] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:04.128283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:04.128876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:04.135502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.135951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.136709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.137145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.281621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:04.290026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5602a958-800b-4d21-b960-33e7767ce27f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165683 Jun 17 13:22:04.290594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1538/3163] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:04 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:04.483728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:04.484247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:04.490854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.491691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.492456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.492885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.556924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:04.566059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-55e1ae17-b275-4f7c-8e84-cd6f13d8057e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086578 Jun 17 13:22:04.566635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1626/3164] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:04.829774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:04.830403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:04.837503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.837947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.838702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.839135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.981445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:04.990430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:04.992317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:04.993465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7f626599-7dbc-4cc2-a5d7-40f926f00429 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167897 Jun 17 13:22:04.994027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1539/3165] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:05.307738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:05.308366 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:05.315990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.316437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:05.317251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.317669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:05.460850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:05.469485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-12395960-0e0e-4795-a7af-196af640a5c9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165741 Jun 17 13:22:05.470061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1627/3166] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:05 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:05.584549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:05.585168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:05.592138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.592636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:05.593416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.593840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:05.665652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:05.674587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a84e7da4-e69d-4af5-abde-c77fa10313b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094618 Jun 17 13:22:05.675161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1540/3167] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:06.013791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:06.014506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:06.021473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.022050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.022823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.023255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.169594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:06.178925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:06.180445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:06.181602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-34ce9c21-db36-43f0-bff6-df08b669dc6a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171907 Jun 17 13:22:06.182159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1628/3168] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:06.490695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:06.491909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:06.503764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.504470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.505703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.506417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.641147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:06.649570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-94b3cc10-b538-42b9-bed1-c4ee664cbf7f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166266 Jun 17 13:22:06.650140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1541/3169] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:06 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:06.693924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:06.694711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:06.697424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=76 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:06.703093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.703567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.704336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.704771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.708957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:06.777968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:06.787693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9f439a3-2317-44ac-8e31-18887d902893 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099325 Jun 17 13:22:06.789912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1629/3170] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:07.201823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:07.202454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:07.210439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.211077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.212332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.212969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.352975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:07.362012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:07.363545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:07.364706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-68f9fb85-f785-4a9e-8e2a-b3f37d55d246 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167025 Jun 17 13:22:07.365259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1542/3171] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:22:07.667402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:07.668109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:07.675642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.676129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.677008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.677508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.807452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:07.808040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:07.815150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.815599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.816373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.816808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.831411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:07.842682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-933a07c0-6e33-4605-9fe5-48e622585027 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.179237 Jun 17 13:22:07.843315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1630/3172] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:07 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:07.889590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:07.898198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f86a2323-fb85-4c6b-8503-485e8aa80cbd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096610 Jun 17 13:22:07.898803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1543/3173] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:08.385611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:08.386122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:08.392794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.393237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.394000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.394431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.533001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:08.541654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:08.543114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:08.544281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2a9d8323-de54-4dfb-ad61-64ad39e307cb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162880 Jun 17 13:22:08.544836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1631/3174] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:08.861861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:08.862496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:08.873337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.874037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.876645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.877162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.917614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:08.918319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:08.926274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.926717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.927605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.928171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.998008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:09.006877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-20e3a6fa-78e2-42ec-9282-571bea7ed17e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093819 Jun 17 13:22:09.007502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1632/3175] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:09.022278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:09.030872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8bd471aa-ecd6-47ab-9316-7dfaf4193f3b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.174021 Jun 17 13:22:09.031576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1544/3176] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:08 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:09.563615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:09.564266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:09.572724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:09.573432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:09.574602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:09.575259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:09.727378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:09.736674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:09.738144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:09.739336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3f27ef79-1a31-467c-956f-23d24ecc1fa7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.180337 Jun 17 13:22:09.739910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1633/3177] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:10.024719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:10.025366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:10.032416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.032869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.033639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.034074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.050005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:10.050572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:10.057617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.058058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.058811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.059208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.098698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:10.107058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e79ceb38-6a83-4305-ac0b-ccfbf45550ce tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086287 Jun 17 13:22:10.107685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1545/3178] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:10.195555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:10.204534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fca1c997-e786-4311-9606-ecd5dbc483c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159292 Jun 17 13:22:10.215544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1634/3179] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:10 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:10.762893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:10.763533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:10.770387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.770853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.771632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.772064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.907949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:10.916981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:10.918493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:10.919719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-06c2d02c-8d64-4606-9f88-feb785f7a970 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160746 Jun 17 13:22:10.920304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1546/3180] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:11.125813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:11.126426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:11.133425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.133864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.134614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.135037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.200168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:11.211630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-da032131-1193-4b3a-81df-dfe438d796cf tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090231 Jun 17 13:22:11.212504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1635/3181] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:11.232195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:11.232808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:11.240110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.240574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.241685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.242116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.382131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:11.390788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4d786b1c-891b-4a68-8f26-29d23242afea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162539 Jun 17 13:22:11.391573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1547/3182] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:11 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:11.456296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:22:11.456528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:22:11.943025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:11.943695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:11.950177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.950600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.951409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.951828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.102381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:12.111821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:12.113308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:12.114646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c3e4910-3db9-45e4-bf75-77f0a4e36177 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.175485 Jun 17 13:22:12.115334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1636/3183] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:12.231626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:12.232183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:12.239215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:12.239864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.240418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:12.241244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.314128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:12.322917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-79e935f4-3778-4ce8-a280-3e22b96cbd2c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.095205 Jun 17 13:22:12.323488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1548/3184] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:12.410659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:12.411245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:12.418729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:12.419176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.419972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:12.420408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.577266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:12.585677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e60bd701-44a7-41d6-9388-64b39252118b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.179641 Jun 17 13:22:12.586215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1637/3185] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:12 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:13.133307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:13.133913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:13.140382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.140823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.141999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.142431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.285141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:13.298610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:13.301015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:13.302342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ae0f1880-6eaa-4c45-8269-7298c2fda32c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173024 Jun 17 13:22:13.303070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1549/3186] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:13.340575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:13.341180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:13.348055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.348497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.349239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.349660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.432369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:13.441430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b1904fe5-ec7f-44ad-92ce-e9382e3de0db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.104803 Jun 17 13:22:13.442002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1638/3187] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:13.603272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:13.603889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:13.610874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.611348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.612132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.612562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.751399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:13.754935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:13.760683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3c4cb16c-145d-4f21-9288-2a60a21d157e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161371 Jun 17 13:22:13.761255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1550/3188] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:13 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:14.325307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:14.326001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:14.334050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.334501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.335268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.335746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.459125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:14.459811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:14.467141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.467783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.468962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.469586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.485528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:14.494822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:14.496477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:14.497638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-27d6521e-2bfb-4041-84fc-f46fe1d0123e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176516 Jun 17 13:22:14.507427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1639/3189] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:14.534844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:14.543408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a8f909d-c15a-4ea4-bad7-b2bb9a7e4270 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088946 Jun 17 13:22:14.543988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1551/3190] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:14.778090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:14.778690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:14.785793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.786232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.786978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.787406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.918602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:14.927361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-de60650d-cd01-4196-89bc-9266adcfa99b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153254 Jun 17 13:22:14.927945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1640/3191] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:14 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:15.517706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:15.518370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:15.521630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=80 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:15.527566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.528009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.528812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.529241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.561025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:15.561629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:15.569064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.569491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.570461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.570923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.640315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:15.650390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f24f3a43-2d1e-4d5e-a764-3714451c5ed9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093048 Jun 17 13:22:15.651162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1641/3192] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:15.677123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:15.686087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:15.687639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:15.688804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4da9e25e-c827-4b5b-944a-8185826cad25 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.175194 Jun 17 13:22:15.689361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1552/3193] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:15.946921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:15.947447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:15.954607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.955046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.955841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.956294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.093704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:16.102050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-317507d1-ed59-477f-ae8b-9dc223651f54 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160036 Jun 17 13:22:16.102621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1642/3194] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:15 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:16.668352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:16.668965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:16.675981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:16.676421 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.677174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:16.677598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.707593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:16.708218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:16.715106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:16.715590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.716346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:16.716772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.742144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:16.750252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-abcf1430-76d6-4b5b-a056-e88bce6d01c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085781 Jun 17 13:22:16.750816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1553/3195] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:16.850035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:16.858601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:16.860168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:16.861354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d3ebab07-88ca-465a-9b7a-d510e0992acf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.157651 Jun 17 13:22:16.861920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1643/3196] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:17.120347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:17.120961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:17.127685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.128136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.128882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.129328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.258800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:17.267103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-091930a8-9d72-4db1-ad04-3f412a3b2dc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.151134 Jun 17 13:22:17.267629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1554/3197] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:17 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:17.767757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:17.768400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:17.775273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.775758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.776516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.776944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.839564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:17.847693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-efb75ecd-47d1-4263-bd2c-f71770a9cc5c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083903 Jun 17 13:22:17.848247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1644/3198] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:17.880026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:17.880637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:17.887933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.888423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.889189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.889624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.033891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:18.043230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:18.044846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:18.046069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8c41af88-61f6-44d3-adda-ac679377538d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169956 Jun 17 13:22:18.046659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1555/3199] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:18.285520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:18.286029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:18.292787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:18.293229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.293996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:18.294417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.432378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:18.435857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:18.441110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0614e6f1-ac9a-47ab-8681-2f419c4302dc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159654 Jun 17 13:22:18.441669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1645/3200] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:18 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:18.865171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:18.866161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:18.872686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:18.873123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.873910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:18.874345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.936402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:18.945176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1385eaa6-227f-463c-a7d2-e8248e01a351 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083977 Jun 17 13:22:18.945738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1556/3201] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:19.065119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:19.065751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:19.073625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.074071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.074811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.075237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.210496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:19.219186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:19.220721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:19.221910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5d842bcb-8647-4cf2-8eaf-a2fef15ecdfd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161296 Jun 17 13:22:19.222473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1646/3202] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:19.458164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:19.458680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:19.465398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.465843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.466601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.467029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.611144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:19.620594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2b42af81-d54e-4408-b4af-fc929946975d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166510 Jun 17 13:22:19.621141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1557/3203] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:19 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:19.963043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:19.963698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:19.970191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.970636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.971409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.971851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.041020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:20.049459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-597d2c24-481d-4289-8d7a-40aeb0e72ed6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090623 Jun 17 13:22:20.050127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1647/3204] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:20.246405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:20.247355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:20.255041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.255538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.256327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.256878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.395176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:20.404212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:20.405703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:20.406871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b6cac7da-c8ed-44be-9c9f-af35f63897ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165134 Jun 17 13:22:20.407727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1558/3205] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:20.639084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:20.639783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:20.646540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.646977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.647763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.648323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.793320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:20.802331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d4a170c0-d348-4223-bd57-5dcb209ead18 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167096 Jun 17 13:22:20.803120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1648/3206] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:20 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:21.066344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:21.066945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:21.074382 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.074817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.075598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.076023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.141044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:21.150808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-178e28eb-f7b7-47ab-b9bd-9550703533c4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088087 Jun 17 13:22:21.151396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1559/3207] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:21.430431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:21.430916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:21.437216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.437685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.438400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.438825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.573581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:21.588394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:21.590964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:21.592992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-699e30eb-279e-474c-94e9-c9cd5afc6486 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166859 Jun 17 13:22:21.593943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1649/3208] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:21.819885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:21.820494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:21.827578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.828026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.828805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.829242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.967952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:21.976667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7b7d424c-1b3b-4076-835d-7c7619ce431c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160690 Jun 17 13:22:21.977268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1560/3209] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:21 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:22.168299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:22.168908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:22.175875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:22.176321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:22.177079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:22.177512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:22.243990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:22.252505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1fc9d937-9293-4ff9-a00c-3399758a91b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088123 Jun 17 13:22:22.253080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1650/3210] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:22.617496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:22.618091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:22.624953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:22.625392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:22.626142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:22.626563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:22.768455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:22.782556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:22.784739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:22.786687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff267cf5-73fa-43ff-b997-7d1ea871e3b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173545 Jun 17 13:22:22.787762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1561/3211] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:22.995067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:22.995755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:23.002794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.003238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.004053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.004484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.144542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:23.154097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f4818704-b569-4c94-b037-ee758b16a417 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163611 Jun 17 13:22:23.154706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1651/3212] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:22 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:23.270144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:23.270722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:23.281034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.281472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.282227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.282653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.358248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:23.370086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b15a0141-e611-4efd-b960-02d6c406bff4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.104033 Jun 17 13:22:23.370724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1562/3213] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:23.811764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:23.812915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:23.820141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.820603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.821390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.821829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.958293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:23.967569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:23.969162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:23.970310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-85fb1ec8-c19e-434f-9335-c838f4d2d237 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163759 Jun 17 13:22:23.971022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1652/3214] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:24.177634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:24.178252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:24.187946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.188548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:24.189685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.190403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:24.332976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:24.342067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-99216aa7-2472-41f4-9b4c-9d286040ece1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171737 Jun 17 13:22:24.342652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1563/3215] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:24 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:24.392400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:24.393042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:24.400789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.401233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:24.402002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.402442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:24.475619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:24.485899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-28b9eb71-a6e9-4983-a3b2-91dac0ecaf8d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097258 Jun 17 13:22:24.488567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1653/3216] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:24.996300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:24.997539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:25.008110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.008793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.010198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.011002 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.157066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:25.169821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:25.171966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:25.173635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-10dbb207-2e43-4349-a9bc-e7fce60d2263 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.181685 Jun 17 13:22:25.174503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1564/3217] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:25.361470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:25.362058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:25.370820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.371246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.372243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.372805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.504524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:25.505279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:25.512439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.512882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.513979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.514744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.535639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:25.544404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-10c6dee2-b44e-4829-b5fe-46a6c30cd7bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.188024 Jun 17 13:22:25.545002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1654/3218] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:25 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:25.587620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:25.596785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-acc82149-aa9c-4ad8-9206-e6386aaea9f6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096489 Jun 17 13:22:25.597349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1565/3219] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:26.198432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:26.199018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:26.206070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.206505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.207345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.208037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.363194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:26.377834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:26.379395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:26.380995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5fbe6bfe-d5e8-470a-b433-5d36b6c48cef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.188174 Jun 17 13:22:26.381640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1655/3220] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:26 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:26.562802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:26.563489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:26.573241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.573843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.575096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.576487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.614506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:26.615008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:26.628693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.629392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.630389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.631233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.710613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:26.719669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2514f037-b9ac-47c9-b22a-a40bf264ef67 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.109125 Jun 17 13:22:26.721169 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1656/3221] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:26.739927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:26.750065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70d8d5ba-1bc8-4929-b549-ed7a1573fb4f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.191267 Jun 17 13:22:26.750635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1566/3222] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:26 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:27.400181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:27.401371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:27.408407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.408837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.409588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.410012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.550121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:27.561130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:27.562662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:27.563863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-39aca116-b031-476f-9e77-7b03a33020fb tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167798 Jun 17 13:22:27.564426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1657/3223] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:27.737934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:27.738586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:27.745815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.746286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.747056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.747509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.767642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:27.767870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:27.768542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:27.774982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.777009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.777009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.777009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.816301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:27.824763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-815cab54-b135-4a6f-bf48-ed3bc1ea0226 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090772 Jun 17 13:22:27.825315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1567/3224] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:27.919953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:27.929119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a6200597-95a8-4747-8712-47e6bac7c412 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165210 Jun 17 13:22:27.929870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1658/3225] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:27 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:28.584620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:28.585214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:28.592828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.593451 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.594028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.594461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.738479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:28.747887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:28.749395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:28.750524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-df759bc8-4cb5-4488-88b5-ac34a2014b58 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169926 Jun 17 13:22:28.751066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1568/3226] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:22:28.842603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:28.843264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:28.850654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.851098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.851903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.852329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.923328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:28.932794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-67c43e5d-1fbc-4631-bdb1-e575df82b1a3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094177 Jun 17 13:22:28.933487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1659/3227] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:28.946860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:28.947498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:28.954325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.954766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.955557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.955981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:29.100478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:29.112237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-074ba71b-c7c6-4d93-a875-af22779a3fb9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.168238 Jun 17 13:22:29.112237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1569/3228] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:28 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:29.769224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:29.769820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:29.776239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:29.776677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:29.777430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:29.777853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:29.929668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:29.940392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:29.941970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:29.943449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9648d41e-10ce-4d8d-aa9c-7d92f9af00b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178471 Jun 17 13:22:29.944148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1660/3229] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:29.951163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:29.951883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:29.959285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:29.959784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:29.960541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:29.960964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:30.030595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:30.040837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-313b8e4f-fc65-475f-ba0c-1688d2ee6c12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093440 Jun 17 13:22:30.041424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1570/3230] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:30.135395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:30.136071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:30.142732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.143332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:30.144199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.144640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:30.284723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:30.294948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f33acab8-9e4a-4964-8398-94d491b043d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164063 Jun 17 13:22:30.294948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1661/3231] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:30 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:30.962301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:30.962939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:30.969742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.970221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:30.971198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.971749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.060024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:31.060631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:31.068166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:31.068608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.069368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:31.069793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.088285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:31.109008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:31.121689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:31.123186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:31.124391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-96a023c0-e135-4d00-9a92-8dcbd6c1e913 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166199 Jun 17 13:22:31.124976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1571/3232] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:31.138399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:31.147124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1c9bd786-c41f-47cb-8df3-7a075899ed6e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090930 Jun 17 13:22:31.147723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1662/3233] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:31.316048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:31.316835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:31.323513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:31.323956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.324706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:31.325134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.460463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:31.468626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-871111bc-7204-4db0-aa81-81d52e527ab9 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156988 Jun 17 13:22:31.469212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1572/3234] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:31 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:32.143595 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:32.144210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:32.151295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.151766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.152529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.152957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.165239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:32.165955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:32.173065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.173584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.174764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.175212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.239096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:32.249013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-44b0accf-1e3e-497b-a419-088e232b403c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087525 Jun 17 13:22:32.249826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1573/3235] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:32.297514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:32.307145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:32.308661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:32.309823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0254c51b-9e1c-4a95-9cc3-d709a459f0f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170976 Jun 17 13:22:32.310424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1663/3236] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:32.488037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:32.488661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:32.495993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.496554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.497283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.497714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.650154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:32.661658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ac4c4371-9f6f-4542-ae99-f728cf45e632 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.178748 Jun 17 13:22:32.662287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1574/3237] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:32 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:33.266808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:33.267479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:33.274569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.275015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.275792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.276216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.329061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:33.329720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:33.337238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.337690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.338443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.338861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.342924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:33.353431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b9ce69c3-46f5-4d6f-8816-18c78d4495ad tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090387 Jun 17 13:22:33.353987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1664/3238] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:33.486166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:33.497374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:33.498885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:33.500077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-51b1b9cc-1e77-4ff1-97f9-7f97cf9b8405 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174997 Jun 17 13:22:33.500639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1575/3239] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:33.681427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:33.681953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:33.688268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.688738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.689474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.689942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.823213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:33.831473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-44e7c362-e558-4d3c-97be-a1c7b52b210a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154111 Jun 17 13:22:33.832126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1665/3240] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:33 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:34.370925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:34.371532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:34.378971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.379427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.380200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.380663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.448349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:34.457372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b23f4b1c-ab4f-409a-9a92-ce12262c4735 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090302 Jun 17 13:22:34.457961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1576/3241] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:34.520567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:34.521363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:34.530451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.530451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.530451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.530878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.665735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:34.674556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:34.676272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:34.677440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3edb7651-c08b-446b-8791-a3f1b10eb1a9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162036 Jun 17 13:22:34.678002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1666/3242] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:34.849991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:34.850837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:34.858741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.859263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.860280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.860737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.007534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:35.017868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-810fbc04-f87f-41be-8530-f314c5a5f39a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171935 Jun 17 13:22:35.018434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1577/3243] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:34 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:35.476372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:35.476969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:35.483479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:35.483949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.484689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:35.485112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.551703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:35.560409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1352df6e-413c-4521-8286-eaf66f8558d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088561 Jun 17 13:22:35.561118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1667/3244] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:35.696782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:35.697364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:35.703818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:35.704317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.705074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:35.705504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.841479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:35.851304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:35.852894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:35.854097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-da980843-7a23-47ea-821e-3d2d9f09cde7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161967 Jun 17 13:22:35.854734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1578/3245] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:36.035558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:36.036168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:36.042836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.043218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.044010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.044475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.188470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:36.197613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f828faa5-e561-402d-8d35-223a1c3a825d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166111 Jun 17 13:22:36.198289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1668/3246] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:36 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:36.580106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:36.581050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:36.588773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.588773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.589173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.589698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.662676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:36.672110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0be725a8-0f8e-4e4c-ba5c-78cfbe1bb4ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096957 Jun 17 13:22:36.672753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1579/3247] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:36.874635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:36.875193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:36.877675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=80 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:36.883427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.883917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.884732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.885187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.021235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:37.030350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:37.031849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:37.032997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ce6213f2-fb53-4460-a3a0-67d19295e7e7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162690 Jun 17 13:22:37.033566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1669/3248] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:37.215913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:37.216471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:37.223038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.223680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.224433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.224857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.359844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:37.369506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c36099ba-72f6-4531-a235-22662f3b5abd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157563 Jun 17 13:22:37.370047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1580/3249] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:37 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:37.690736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:37.691427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:37.697992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.698450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.699245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.699726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.770720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:37.779607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e2841a2f-52ee-4532-adf3-b2e1ab3ecd8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092803 Jun 17 13:22:37.780370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1670/3250] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:38.052639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:38.053149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:38.060736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.061172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.061937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.062369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.198397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:38.207873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:38.209492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:38.210652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa404e73-f0e2-47c6-a166-bafd441b2c08 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162260 Jun 17 13:22:38.211212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1581/3251] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:38.387274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:38.388060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:38.395080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.395545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.396306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.396737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.532620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:38.541674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c8c0ecd6-6eaf-44af-a31c-285db1a39f72 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158390 Jun 17 13:22:38.542269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1671/3252] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:38 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:38.798930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:38.799647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:38.806461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.806905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.807698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.808120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.871506 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:38.880266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-65eb397b-7132-47b2-9520-5e0fb9565c69 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085278 Jun 17 13:22:38.880832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1582/3253] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:39.229458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:39.230062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:39.236578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.237022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.237772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.238199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.375443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:39.384584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:39.386043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:39.387186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c01e8812-0f49-477b-aeba-ccb7849661c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161746 Jun 17 13:22:39.387801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1672/3254] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:39.559233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:39.559874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:39.566615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.567700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.568480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.568888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.704071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:39.712700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-21c84c97-48f9-4e1c-aaa8-da89a94e735f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157396 Jun 17 13:22:39.713262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1583/3255] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:39 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:39.898056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:39.898697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:39.905859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.906265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.907131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.907627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.971758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:39.980079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aecd078d-e748-4467-b57f-f889ebfe1415 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086298 Jun 17 13:22:39.980645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1673/3256] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:40.407015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:40.407687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:40.414152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.414593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.415352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.415812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.419842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:40.551776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:40.561441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:40.563092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:40.564316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f74d184-670e-45fb-9578-5a10eeec3636 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161895 Jun 17 13:22:40.564873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1584/3257] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:22:40.730839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:40.731444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:40.737707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.738164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.738959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.739453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.876039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:40.884721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bf897529-7da6-4942-bf48-c77d422b011d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157990 Jun 17 13:22:40.885287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1674/3258] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:40 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:40.997753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:40.998367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:41.005589 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.006035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:41.006797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.007229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:41.074345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:41.082818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6fb92fb7-6789-4469-9ed4-a5e8d5b78118 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089060 Jun 17 13:22:41.083518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1585/3259] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:41.583215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:41.583993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:41.591410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.591950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:41.592758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.593239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:41.724772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:41.733466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:41.734953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:41.736142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9e372a1c-f659-4d00-8831-5c6a1051c035 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.157708 Jun 17 13:22:41.736697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1675/3260] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:41.905244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:41.906192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:41.913110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.913537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:41.914301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.914730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.062610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:42.073825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5e690a32-09c8-4a5c-9e42-687a515ec210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173033 Jun 17 13:22:42.074602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1586/3261] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:41 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:42.102485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:42.103320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:42.110499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.110979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.111798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.112227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.190180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:42.200916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bc2510da-2b92-41c6-9a72-d21e2a4491f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.103676 Jun 17 13:22:42.201622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1676/3262] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:42.756576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:42.757181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:42.763914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.764359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.765124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.765556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.907571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:42.917348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:42.918891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:42.920140 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a716fdde-9fa2-4239-9e84-5a9aff8d8c82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167904 Jun 17 13:22:42.920718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1587/3263] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:43.094805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:43.095705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:43.103472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.103948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.104708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.105135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.220513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:43.221095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:43.228933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.229375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.230149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.230574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.244360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:43.252836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-acfb3ac2-6657-4146-b6f9-1aadcfe4a561 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162220 Jun 17 13:22:43.253461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1677/3264] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:43 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:43.317723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:43.329754 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-761bb292-4eeb-4680-9b4c-03b218d83015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.113115 Jun 17 13:22:43.330670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1588/3265] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:43.942844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:43.943681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:43.951291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.951771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.952566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.952996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.090520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:44.100431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:44.101988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:44.103092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8232a64d-adb0-4333-bbba-0bcd0c374a6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166017 Jun 17 13:22:44.103692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1678/3266] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:44.270640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:44.271362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:44.278267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:44.278732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.279499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:44.279959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.351521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:44.352149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:44.361456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:44.362100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.362938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:44.363406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.369161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:44.422720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:44.432082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d5a00f49-5215-4674-9f0f-f49165b56ba7 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165495 Jun 17 13:22:44.432697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1589/3267] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:44 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:44.436653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:44.447406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7ee13203-3c09-4f68-b2fa-e21b0d67a3e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.101155 Jun 17 13:22:44.447988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1679/3268] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:45.126556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:45.127215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:45.136020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.136505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.137477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.138027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.280949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:45.290379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:45.291919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:45.293060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9b36e346-d9f6-477b-9873-c4e08ad625ed tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172014 Jun 17 13:22:45.293587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1590/3269] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:45.450082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:45.450834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:45.457387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.457873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.458653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.459066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.464798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:45.465411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:45.472264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.472711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.473482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.473933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.543723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:45.552088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cd66d9ac-a677-4326-b28d-0f93755ae759 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091416 Jun 17 13:22:45.552789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1591/3270] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:45.609509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:45.621906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d7e21fd0-fa00-4793-bd4b-6da161ba1be6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.175574 Jun 17 13:22:45.622538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1680/3271] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:45 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:46.313065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:46.313780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:46.316168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=80 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:46.322180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.322618 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.323395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.323864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.460560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:46.470274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:46.472008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:46.473367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e58cf269-d8d7-4baa-8b10-208c378c99b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164244 Jun 17 13:22:46.474049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1592/3272] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:46.569820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:46.570438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:46.577604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.578049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.578835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.579267 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.642567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:46.643239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:46.643459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:46.650081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.650671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.651598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.651858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-10c1d121-9b1e-445b-8f51-5fa71cad8c71 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085914 Jun 17 13:22:46.652079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.652445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1681/3273] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:46.793378 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:46.801831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7f222be9-ba17-4595-be86-07296a5ad6a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163444 Jun 17 13:22:46.802401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1593/3274] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:46 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:47.497046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:47.498064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:47.506928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.507742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.508778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.509488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.645552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:47.654671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:47.657271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:47.657465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-37361e57-053b-43cb-b951-0290485e581f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166623 Jun 17 13:22:47.657969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1682/3275] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:47.669060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:47.669709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:47.676587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.677031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.677803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.678232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.743545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:47.752738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cf3d2a6d-1164-4c53-b3d7-716161a318e0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087568 Jun 17 13:22:47.753240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1594/3276] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:47.819900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:47.820501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:47.827415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.827857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.828609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.829031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.973171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:47.981901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-43625544-52e5-47d6-afae-906962bc1da1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165859 Jun 17 13:22:47.982472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1683/3277] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:47 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:48.676450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:48.677087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:48.684896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:48.685340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:48.686110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:48.686538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:48.770820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:48.771794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:48.780054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:48.780495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:48.781254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:48.781685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:48.825391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:48.834316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:48.835921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:48.837121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f93258bd-7846-4887-82f1-5f7c20aec3c4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164703 Jun 17 13:22:48.837889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1595/3278] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:48.845370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:48.853743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2a86b37-9f8d-43b4-bae4-b9fc933e6ba4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087459 Jun 17 13:22:48.854278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1684/3279] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:49.000016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:49.000621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:49.006877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.007318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.008095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.008522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.155228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:49.163963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-13da9ca3-127e-42c8-8c56-e027ce91ad71 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167812 Jun 17 13:22:49.164535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1596/3280] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:48 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:49.858486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:49.859172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:49.866685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.867134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.867937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.868373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.870819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:49.871308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:49.878443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.878886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.879691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.880159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.949287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:49.965235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-db7ac9b9-4730-486d-b91c-40a38ef60fae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098131 Jun 17 13:22:49.966197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1597/3281] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:50.009712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:50.018510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:50.020050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:50.021219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81b68e87-9007-4083-b268-f53b779b0369 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168686 Jun 17 13:22:50.021763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1685/3282] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:50.181798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:50.182420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:50.189096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.189540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:50.190300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.190730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:50.347162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:50.360455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-03da79a1-9aec-46af-86f1-86784ff1d3fd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.182449 Jun 17 13:22:50.361503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1598/3283] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:50 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:50.989138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:50.990159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:50.997235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.997676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:50.998431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.998860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.039917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:51.040517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:51.047286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:51.047801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.048551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:51.048983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.175680 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:51.184162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-664fc841-2df0-4c08-8b4c-5315215a0aed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.198908 Jun 17 13:22:51.184787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1686/3284] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:51.189674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:51.198981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:51.200803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:51.202093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-83f891ea-e292-49ce-89cc-6d059a1b4b6d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166463 Jun 17 13:22:51.202672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1599/3285] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:51.380399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:51.381009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:51.389032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:51.389032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.389359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:51.389808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.525606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:51.534069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-46f365d0-87b1-4d00-b3cb-9deddb06e482 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157624 Jun 17 13:22:51.534640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1687/3286] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:51 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:52.201906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:52.202559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:52.212235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.213403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.214706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.215662 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.225733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:52.226777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:52.234534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.234955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.235752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.236181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.287744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:52.294940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:52.305333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-56fe5063-f354-49a3-8061-467ce6ecbee2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.106926 Jun 17 13:22:52.306487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1600/3287] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:52.382504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:52.391361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:52.392891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:52.394053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3e23cd47-8c7a-4b11-bf7f-18969b59a411 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174970 Jun 17 13:22:52.394616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1688/3288] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:52.554475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:52.555082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:52.561952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.562392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.563151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.563624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.694916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:52.704003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cff517ee-fd04-4ee0-9ca9-a91fc73eff26 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153477 Jun 17 13:22:52.704580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1601/3289] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:52 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:53.324288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:53.324930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:53.333588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.334252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.335564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.336256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.403073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:53.414541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a5b090b7-d77b-4a73-83a1-1673f93a135c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093874 Jun 17 13:22:53.415350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1689/3290] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:53.416201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:53.417584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:53.430010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.430636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.431912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.432416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.577428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:53.589814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:53.592164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:53.594076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6132169-0d84-42d0-bac3-5e5fc9164753 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.183977 Jun 17 13:22:53.594777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1602/3291] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:22:53.721691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:53.722187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:53.729108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.729543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.730295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.730719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.861455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:53.870613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b9f54a2b-8537-4bd9-88b8-f22897a3d96b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.152942 Jun 17 13:22:53.871152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1690/3292] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:53 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:54.443235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:54.444138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:54.452770 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.453222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.453986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.454423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.522998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:54.531656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2a9bb45e-6fc5-43cd-88e3-0b671de0f7aa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094701 Jun 17 13:22:54.532266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1603/3293] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:54.618054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:54.619290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:54.625773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.626211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.626971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.627399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.763222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:54.772756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:54.774249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:54.775533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-00ab290a-67e0-42d6-8a29-b47e356e2935 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164543 Jun 17 13:22:54.776105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1691/3294] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:54.887916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:54.888538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:54.894742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.895166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.895952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.896384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.037906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:55.047981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1cc1c1cd-9ef4-4acf-8efe-85ab6f95163b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164113 Jun 17 13:22:55.048567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1604/3295] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:54 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:55.548492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:55.549101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:55.555702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:55.556183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.557264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:55.557571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.620125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:55.628547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b255bc3c-f7b4-4ecd-9131-7cab180b7738 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084035 Jun 17 13:22:55.629114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1692/3296] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:55.794782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:55.795505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:55.805127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:55.805577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.806346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:55.806781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.960602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:55.969651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:55.971158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:55.972344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-21450835-14e9-4e6c-bad1-d5cf51ad9eb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.181933 Jun 17 13:22:55.972902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1605/3297] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:56.066784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:56.067295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:56.074551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.074996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.075788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.076215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.224146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:56.233499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a9c407a5-cfad-4433-98e5-3b1fce9e2e31 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.170630 Jun 17 13:22:56.234178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1693/3298] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:56 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:56.645947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:56.646615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:56.653437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.653884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.654643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.655077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.717673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:56.725954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d4f6a311-2e49-4d58-b73b-2a620ef41021 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084010 Jun 17 13:22:56.726478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1606/3299] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:56.991719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:56.992306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:56.998969 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.999405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.000172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:57.000604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.136456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:57.145082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:57.146571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:57.147752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c0bc343f-1da9-4a8d-adf1-2b5237ecc544 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160537 Jun 17 13:22:57.148301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1694/3300] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:57.252627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:57.253269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:57.260277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:57.260853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.261826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:57.262251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.398965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:57.407279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7c760e01-fba3-4cde-86d8-75e304767cad tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158556 Jun 17 13:22:57.407892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1607/3301] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:57 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:57.744521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:57.745132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:57.751589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:57.752030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.752776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:57.753202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.819548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:57.823201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:57.828706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-06a2e037-87cd-40a1-a7a1-944bcd9b88c8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088268 Jun 17 13:22:57.829290 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1695/3302] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:58.167585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:58.168281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:58.175821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.176319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.177124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.177612 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.339978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:58.349617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:58.351120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:58.352352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-af9cd44b-5916-4eca-860b-59de4f790f46 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.189569 Jun 17 13:22:58.352873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1608/3303] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:58.425124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:58.425705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:58.432858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.433384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.434144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.434576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.576761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:58.585292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d213dd64-b7bf-4aad-9c54-f7eeb82d946e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164358 Jun 17 13:22:58.585865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1696/3304] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:58 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:58.852227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:58.853185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:58.861436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.861881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.862646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.863085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.927537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:58.936172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bba4457e-0940-469e-bf72-bfa8bd41d714 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090397 Jun 17 13:22:58.936745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1609/3305] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:59.374446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:59.374959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:59.381511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.381960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.382722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.383150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.517609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:59.526272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:59.527831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:59.528997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ae964643-c780-4302-ad9c-76eda03616c3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158715 Jun 17 13:22:59.529546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1697/3306] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:22:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:22:59.603431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:59.604859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:59.612359 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.612810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.613606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.614057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.752046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:59.760758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f9b33bf-4ab9-410c-b051-ee2528787b75 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161183 Jun 17 13:22:59.761146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1610/3307] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:59 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:59.953751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:59.954254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:59.961042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.961492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.962242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.962668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.027631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:00.037393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-48e4dc5f-7087-4a3c-8aa1-9940a27408d3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087527 Jun 17 13:23:00.038027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1698/3308] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:00.547963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:00.548560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:00.555154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:00.555653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.556422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:00.556850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.690399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:00.699505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:00.701038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:00.702289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02b24ceb-1743-4d3d-b15a-066febea14fc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158352 Jun 17 13:23:00.702845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1611/3309] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:00 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:23:00.783718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:00.784754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:00.794699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:00.795146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.795936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:00.796343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.939793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:00.948358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-06f085d8-ccf6-4ef7-8abd-2365df78fd61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171193 Jun 17 13:23:00.948942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1699/3310] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:00 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:01.054278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:01.054888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:01.061579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.062025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.062783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.063208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.129590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:01.138761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eb94cd90-7b51-4c21-a2c3-cc116241e44c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088280 Jun 17 13:23:01.139366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1612/3311] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:01.721830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:01.722436 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:01.729732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.729915 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.730669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.731225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.875034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:01.883607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:01.885092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:01.886247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5cf4ea43-3c81-4490-be4e-510b419e8523 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168469 Jun 17 13:23:01.886807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1700/3312] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:01.965913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:01.966470 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:01.973556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.973928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.974683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.975121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.113788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:02.123871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2afbeaf6-2b8d-4e05-81e7-6e608d83e08a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161974 Jun 17 13:23:02.124698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1613/3313] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:01 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:02.157738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:02.158337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:02.164548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.164991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.165735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.166168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.229385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:02.242529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-27590409-71a5-492a-a9d0-0ff4d8ff296f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088312 Jun 17 13:23:02.243331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1701/3314] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:02 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:02.905053 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:02.905710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:02.912263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.912714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.913475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.913910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.057202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:03.066302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:03.067828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:03.068993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-703ce101-fe0a-4003-bc99-2ab720946373 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168156 Jun 17 13:23:03.069562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1614/3315] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:03.143686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:03.144284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:03.151350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.151910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.152780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.153238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.265296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:03.265902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:03.272242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.272689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.273583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.274016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.288195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:03.298507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-703a74df-b7cc-45f6-b980-d45c9c016a05 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157069 Jun 17 13:23:03.298507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1702/3316] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:03 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:03.340913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:03.349364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aaab8868-1003-4561-a98a-ac24fe66a8d4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088020 Jun 17 13:23:03.349986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1615/3317] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:04.092311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:04.092311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:04.097629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.098067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.098830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.099255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.314806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:04.315585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:04.317276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:04.322819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.323254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.324315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.324748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.327257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:04.328875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:04.330025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2e091983-2cf7-4c59-8355-10fbba1edbc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.245220 Jun 17 13:23:04.330794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1703/3318] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:04.366682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:04.367415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:04.374198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.374645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.375671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.376295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.443724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:04.452781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a53fbf8d-914b-4abe-a484-ba374a4bcb46 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090488 Jun 17 13:23:04.453328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1704/3319] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:04.466764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:04.474903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-60ed62e7-6e8e-4b69-99ed-d4ab9b4b524f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164351 Jun 17 13:23:04.475481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1616/3320] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:04 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:05.349335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:05.349987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:05.357400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.357816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.358609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.359013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.470090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:05.470802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:05.478119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.478563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.479336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.479800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.510208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:05.511970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:05.520926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:05.522431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:05.523648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a0c460ff-c3ac-44aa-b864-623cac216b24 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178315 Jun 17 13:23:05.524194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1705/3321] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:05.528757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:05.529361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:05.536894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.537362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.538147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.538580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.563973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:05.572251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a03b6450-f98c-4826-8c88-2cbc7ae4548f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.106111 Jun 17 13:23:05.572778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1617/3322] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:05.673661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:05.687855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e9387704-eac2-4f5b-9595-2bff3f30b92c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162611 Jun 17 13:23:05.688437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1706/3323] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:05 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:06.542246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:06.542857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:06.549996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.550450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.551243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.551723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.589004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:06.589634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:06.597103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.597553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.598319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.598757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.664598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:06.683871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:06.688506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3b579c08-84a2-421d-a1b1-73aecd2fd003 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.103304 Jun 17 13:23:06.689096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1707/3324] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:06.693216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:06.694728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:06.696016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b7fac017-e832-41eb-8e45-e64ab78c80b2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.157796 Jun 17 13:23:06.696721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1618/3325] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:06.712155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:06.712859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:06.721121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.721615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.722409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.722917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.866251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:06.876771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f6ca52d2-8e93-4d8a-9228-38cccd0df4b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171334 Jun 17 13:23:06.877339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1708/3326] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:06 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:07.711654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:07.712633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:07.719638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:07.720246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:07.721239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.721656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.722118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=80 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:07.722753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.722898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.727776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.728225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.728990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.729421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.791755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:07.800172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-de3f6e9b-6447-42ef-a5f2-bef544fda73a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.095064 Jun 17 13:23:07.800721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1619/3327] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:07.866817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:07.880575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:07.883052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:07.884957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5657fc0f-64ec-4353-8ac2-52c99223ad48 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170342 Jun 17 13:23:07.885832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1709/3328] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:07 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:07.894746 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:07.895349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:07.904635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.905242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.906387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.906965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.045911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:08.054488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cf6a95da-0a9d-46c8-8fc6-342ca6b60ce8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163605 Jun 17 13:23:08.055056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1620/3329] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:07 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:08.820837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:08.821666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:08.830036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.830477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.831232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.831699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.894801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:08.903557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1de6c4cb-94ec-4d53-b47c-9d87d98b2d64 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088999 Jun 17 13:23:08.904129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1710/3330] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:08.905883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:08.906490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:08.913471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.913909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.914725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.915171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.054886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:09.064076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:09.066764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:09.066764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-709a2c95-d2f8-403b-a339-f456a54e07b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165519 Jun 17 13:23:09.067306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1621/3331] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:09.072206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:09.072775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:09.079098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.079582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.080336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.080768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.218841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:09.231447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c19a1cc8-e748-45ca-af07-a83ea73bf962 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163010 Jun 17 13:23:09.232101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1711/3332] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:09 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:09.921684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:09.922355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:09.929162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.929601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.930350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.930776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.995275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:10.006106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4792655b-240c-4d93-8295-d4ba479aedb8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088659 Jun 17 13:23:10.006891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1622/3333] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:10.087206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:10.087865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:10.095119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.095600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:10.096367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.096798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:10.121394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:10.233968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:10.243283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:10.244940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:10.246078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be1a6aba-d6a3-4a22-a758-549ae10c3384 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163510 Jun 17 13:23:10.246651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1712/3334] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:10.249630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:10.250235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:10.256774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.257220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:10.257976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.258402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:10.396235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:10.405036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0065d0ac-c4c2-4fd5-b0f6-924d74635c1a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159627 Jun 17 13:23:10.405578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1623/3335] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:10 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:11.026101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:11.026707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:11.033871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.034311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.035054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.035526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.097740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:11.105964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-39aec082-9cbe-4476-9bbd-f252caf2e500 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083803 Jun 17 13:23:11.106501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1713/3336] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:11.267357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:11.268055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:11.277604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.278037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.279175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.279712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.424214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:11.425122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:11.432932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.433464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.434503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.435510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.442898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:11.451743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:11.453272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:11.454466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f572c772-245f-433f-bc1b-a21bb5b03c66 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.193136 Jun 17 13:23:11.455023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1624/3337] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:11.577557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:11.585711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-99cd4b79-1bb6-4eb9-9518-5c716ddc3175 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166963 Jun 17 13:23:11.586319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1714/3338] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:11 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:12.123414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:12.124066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:12.132064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.132511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.133279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.133738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.198715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:12.207003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1968f464-3775-4104-972a-103387ed7c01 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087812 Jun 17 13:23:12.207610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1625/3339] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:12.473244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:12.473853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:12.480716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.481167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.481925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.482361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.603722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:12.604559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:12.611732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.612214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.613014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.613449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.619797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:12.630491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:12.632138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:12.633415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a1cb03ee-362e-4ef3-8ca0-99539f842f26 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164254 Jun 17 13:23:12.634071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1715/3340] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:12.756146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:12.767118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-67582c36-9408-4bd9-9d92-571f5b3ec3b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167271 Jun 17 13:23:12.767747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1626/3341] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:12 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:13.231205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:13.231829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:13.238298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.238743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.239912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.240341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.304590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:13.313342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b1465a94-0b83-49cd-bef5-68191023b529 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086029 Jun 17 13:23:13.313953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1716/3342] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:13 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:13.652565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:13.653148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:13.660166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.660619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.661374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.661821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.786045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:13.786045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:13.792640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.793086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.793855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.794287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.802475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:13.811565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:13.813223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:13.814630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-960afec5-c47d-49c5-9e8b-26e693ca5bc8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166190 Jun 17 13:23:13.815182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1627/3343] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:13 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:13.938987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:13.947248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d28b4d54-130b-4ebf-ae2f-caf66a564e6d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165933 Jun 17 13:23:13.947940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1717/3344] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:13 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:14.331833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:14.332455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:14.339585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.340036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.340938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.341402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.420146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:14.432399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2ec4812c-f1c8-46a7-9858-c558a224b6a8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.104926 Jun 17 13:23:14.433230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1628/3345] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:14.836919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:14.837852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:14.847640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.848098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.848873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.849302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.965914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:14.966964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:14.974239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.974705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.975509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.975931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.990810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:14.999672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:15.001298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:15.002592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-911f2323-1870-4e90-b737-ebb0b88ca793 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172130 Jun 17 13:23:15.003093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1718/3346] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:15.109236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:15.118831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-75923590-7933-44e8-80a9-6cfe2cfe34dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156749 Jun 17 13:23:15.119406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1629/3347] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:14 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:15.454179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:15.455099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:15.461700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:15.462173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:15.462908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:15.463409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:15.526443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:15.534930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f01ab080-ea27-4999-baa2-5bd8bd947236 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084762 Jun 17 13:23:15.535537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1719/3348] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:16.023259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:16.023949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:16.031319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.031827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.032591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.033027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.136829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:16.137475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:16.144147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.144593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.145363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.145788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.173206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:16.182354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:16.183890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:16.185092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-adf4bf89-8e95-4c6a-b7c3-2b06ec8bd44b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166349 Jun 17 13:23:16.185653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1630/3349] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:16.281971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:16.290477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-93767d35-05e2-4151-ae44-11ff631ed5a5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157876 Jun 17 13:23:16.291049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1720/3350] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:16 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:16.552794 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:16.553283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:16.555183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=78 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:16.561028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.561448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.562211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.562643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.624773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:16.633327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48735ce2-73ba-478f-8d66-633e0080ba38 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084651 Jun 17 13:23:16.633898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1631/3351] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:17.204099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:17.204964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:17.212010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.212453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.213203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.213630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.308168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:17.308789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:17.315991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.316434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.317209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.317633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.348532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:17.358379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:17.359859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:17.361310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8d27689b-f1a1-4e07-8719-5725d6e1d0d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161098 Jun 17 13:23:17.361693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1721/3352] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:17.462839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:17.471935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e266d654-abb3-454c-921e-9bf28c4702b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167512 Jun 17 13:23:17.472538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1632/3353] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:17 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:17.651989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:17.652630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:17.659340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.659746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.660512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.660950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.723047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:17.731640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b1797d8d-d83c-48a9-b275-833097baf806 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084860 Jun 17 13:23:17.732596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1722/3354] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:18.381762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:18.382349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:18.389364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.389805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.390558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.391020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.489887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:18.490493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:18.497314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.497764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.498526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.498960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.528738 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:18.538120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:18.539658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:18.540824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-462eafce-3970-4a40-ac0d-dd159310cc7a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163215 Jun 17 13:23:18.541391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1633/3355] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:18.636934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:18.645194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2bc98700-d907-495e-b4f4-fe8ffe4b1844 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159756 Jun 17 13:23:18.645765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1723/3356] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:18 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:18.752348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:18.752961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:18.759795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.760244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.760999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.761429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.765709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:18.828736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:18.837393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0878d999-d801-4561-b1e4-9e049f0ac88f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091755 Jun 17 13:23:18.837973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1634/3357] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:19.560667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:19.561323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:19.568719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.569159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.569912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.570338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.662301 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:19.662900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:19.669840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.670286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.671049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.671513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.703066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:19.718729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:19.720327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:19.721507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6fca2172-7774-4666-bca4-49bf100124d0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164947 Jun 17 13:23:19.722065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1724/3358] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:19.809159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:19.818191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5bee8585-d878-47ae-9ffe-783e073ac7cd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159740 Jun 17 13:23:19.818860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1635/3359] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:19 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:19.854288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:19.854898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:19.861625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.862278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.863524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.864300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.934293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:19.942735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e20df98-cbbf-4e6a-a3bf-35a30273f2b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092388 Jun 17 13:23:19.943305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1725/3360] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:20.740688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:20.741626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:20.749043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.749488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.750292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.750728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.836132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:20.836887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:20.844024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.844470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.845228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.845661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.886864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:20.896028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:20.897456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:20.898627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a153093b-937c-4b9a-8670-7f94ae642d06 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162602 Jun 17 13:23:20.899192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1636/3361] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:20 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:20.960744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:20.961361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:20.967960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.968408 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.969184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.969616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.981374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:20.990592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-35dc2bd3-7237-4853-9119-3d29f4914bc8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158640 Jun 17 13:23:20.991201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1726/3362] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:20 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:21.033856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:21.042202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3682f362-fac2-4923-81f9-bb6d914ef290 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086229 Jun 17 13:23:21.042781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1637/3363] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:21.917323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:21.917980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:21.925245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:21.925541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:21.926302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:21.926727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.011674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:22.012523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:22.020983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.021344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.022110 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.022533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.077857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:22.088463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:22.089947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:22.091109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c913b4c6-c9e0-4566-92e1-e56ea0c81f60 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.177824 Jun 17 13:23:22.091695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1727/3364] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:22.096053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:22.096661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:22.103627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.104064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.104815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.105238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.169233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:22.178228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-607e985d-56e3-4ad8-b808-9366268bcc8b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085483 Jun 17 13:23:22.178812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1728/3365] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:22.424604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:22.433547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-20f85950-2fb4-4c99-aea0-e559d49e4521 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.426350 Jun 17 13:23:22.434197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1638/3366] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:22 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:23.110875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:23.111962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:23.119532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.119988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.120744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.121200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.126017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:23.195727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:23.196351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:23.203658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.204138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.204917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.205351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.271022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:23.271329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:23.280309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:23.280645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0580d65f-5bae-4bf1-89ae-a1486cd48619 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088725 Jun 17 13:23:23.281213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1639/3367] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:23 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:23.281830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:23.282989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d14b321c-c6bb-4761-bb94-9de9034eef4c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176495 Jun 17 13:23:23.283591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1729/3368] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:23.452303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:23.452916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:23.459694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.460138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.460901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.461335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.598456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:23.606945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-63c112eb-20b7-4522-9a6e-9546eac11e0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158711 Jun 17 13:23:23.607532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1640/3369] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:23 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:24.305194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:24.306030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:24.307414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:24.308403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:24.314322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.314742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.315611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.316018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.316724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.317433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.318295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.318970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.391669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:24.400638 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-85230eec-7268-4a71-bb3e-03cc053fba3b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099757 Jun 17 13:23:24.401215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1641/3370] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:24.454088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:24.464611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:24.466107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:24.467276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-947cf97a-37ae-4031-82c2-b91a53057e82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169518 Jun 17 13:23:24.467901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1730/3371] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:24.625707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:24.626230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:24.633086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.633507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.634296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.634729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.769955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:24.778669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-897dbfc2-d5b4-4832-ac0c-87a1e8a8e415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157098 Jun 17 13:23:24.779257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1642/3372] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:24 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:25.417325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:25.417925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:25.425522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.425979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.426739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.427192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.486442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:25.487052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:25.495197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.495669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.496458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.496887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.501474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:25.511883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5ce1977f-bacc-4a19-9dfa-e338b2da163a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098457 Jun 17 13:23:25.521676 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1731/3373] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:25.642916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:25.652138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:25.653649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:25.654809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cfb2a7f6-df7e-45c7-b0d4-3b6218406bfc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172376 Jun 17 13:23:25.655396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1643/3374] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:25.796843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:25.797482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:25.804533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.804960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.805755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.806185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.942623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:25.951809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6cae411f-3a8e-477b-9c0f-94fbc40ed024 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158712 Jun 17 13:23:25.952396 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1732/3375] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:25 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:26.529797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:26.530442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:26.537712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.538168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.538945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.539391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.609675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:26.619252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2b8ae710-c3d4-49b9-a1dd-46e74af90cd1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093434 Jun 17 13:23:26.619857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1644/3376] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:26.673096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:26.673725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:26.680928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.681371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.682115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.682538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.822279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:26.831124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:26.832943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:26.834145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e3dc2b8d-026a-4ceb-b7da-e7d50337a398 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165034 Jun 17 13:23:26.834730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1733/3377] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:26 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:23:26.970547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:26.971176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:26.977893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.978341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.979108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.979581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.118397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:27.129929 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-43af6294-e6dd-4c80-9c48-7353ab4b358b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163342 Jun 17 13:23:27.130509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1645/3378] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:26 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:27.325329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:23:27.325593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:23:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:23:27.640916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:27.641427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:27.648928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.649472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.650428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.650859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.728618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:27.737748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4b9b8546-c7c9-409f-9465-f6c1e0b46a10 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.101828 Jun 17 13:23:27.738362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1734/3379] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:27.852321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:27.852927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:27.860872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.861407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.862171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.862603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.022605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:28.032004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:28.033894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:28.035501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2e509144-1b8e-4341-9a3e-02b21eb74c62 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.187158 Jun 17 13:23:28.036289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1646/3380] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:28.148020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:28.148570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:28.155536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.155974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.156760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.157341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.321331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:28.330161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cb72ccda-326e-4c87-9696-fe965e98e357 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.186384 Jun 17 13:23:28.330828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1735/3381] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:28 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:28.758634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:28.759357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:28.767663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.768230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.769005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.769422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.837136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:28.848636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-14449b83-121f-49b9-b7cd-e484820b3fed tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.095057 Jun 17 13:23:28.849442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1647/3382] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:29.056106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:29.056762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:29.063899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.064342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.065138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.065577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.211426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:29.224151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:29.225638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:29.226791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-45bc722d-9928-48ff-9b4b-adafda32a328 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174908 Jun 17 13:23:29.227395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1736/3383] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:29.349757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:29.350355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:29.358503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.359233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.360400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.361100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.501730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:29.510820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d8df8300-f295-4561-90b4-98fa4340ba0a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.166666 Jun 17 13:23:29.511401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1648/3384] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:29 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:29.868970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:29.869910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:29.878159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.878633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.879415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.880195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.958654 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:29.967470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1da38c4e-97ae-4dc8-b4ae-f64dc1f1ac23 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.104376 Jun 17 13:23:29.968053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1737/3385] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:30.250062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:30.250865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:30.259975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.260521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.261628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.262130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.402633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:30.411574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:30.413528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:30.414698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4544fce1-0954-4ba4-84c3-2805a850008b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169291 Jun 17 13:23:30.415255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1649/3386] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:30.528508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:30.529120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:30.538898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.539334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.540134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.540557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.681715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:30.692578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ec8a7e4d-9af7-444c-854f-138eaeff27c6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167984 Jun 17 13:23:30.693743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1738/3387] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:30 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:30.985111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:30.985711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:30.992717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.993187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.993917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.994374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.059709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:31.063173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:31.068661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-84ec6bed-085f-4a42-b95b-ee743c5802db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087382 Jun 17 13:23:31.069228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1650/3388] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:31.435056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:31.435578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:31.441912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.442353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.443096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.443562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.579326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:31.588859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:31.590644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:31.591861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c32f472-4234-4b36-b68c-ad4d74d1aa83 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160890 Jun 17 13:23:31.592644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1739/3389] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:31.714720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:31.715341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:31.722676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.723124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.723925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.724356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.858282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:31.866926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a89deb98-2407-486d-b9af-bd2f3988f8e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156432 Jun 17 13:23:31.867513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1651/3390] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:31 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:32.089451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:32.090440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:32.101426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.101875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:32.102645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.103077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:32.171137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:32.180108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f59186d8-e532-4ef3-b7ac-cdde38292a60 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096274 Jun 17 13:23:32.180655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1740/3391] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:32.612534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:32.613308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:32.622331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.622927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:32.623985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.624559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:32.762543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:32.775830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:32.777402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:32.778599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-709d942f-44b2-4a81-8576-1b0366cac49d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171408 Jun 17 13:23:32.779202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1652/3392] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:32 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:32.886432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:32.887030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:32.894014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.894474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:32.895225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.895698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.042789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:33.055088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1b850a43-4606-4a02-9483-8ddb3f2513a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173331 Jun 17 13:23:33.055690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1741/3393] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:32 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:33.200695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:33.201515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:33.208888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:33.209336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.210213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:33.210767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.284333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:33.293142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9d5bed6e-ff94-436c-89fd-39ed3f040789 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099033 Jun 17 13:23:33.293692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1653/3394] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:33 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:33.800692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:33.801351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:33.809257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:33.809728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.810490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:33.810919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.949552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:33.958630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:33.960156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:33.962107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-385129a7-737a-4ca2-b6c3-873f60fabce8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165450 Jun 17 13:23:33.962656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1742/3395] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:34.074629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:34.075204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:34.083203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.083742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.084500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.084931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.232658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:34.243709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c52ab0dc-5918-4fa8-af51-e64d2a405ede tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173701 Jun 17 13:23:34.244490 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1654/3396] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:34 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:34.314738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:34.315401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:34.323227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.323694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.324447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.324994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.399108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:34.407781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2021f7e5-86e1-4959-a7ea-c3bcf275fd66 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098133 Jun 17 13:23:34.408369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1743/3397] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:34.981515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:34.982113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:34.989185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.989611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.990381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.990792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.046239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:23:35.047080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:23:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:23:35.138163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:35.147438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:35.148971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:35.150241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3beefd5a-5647-4b13-9fad-889a93ff7f37 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172869 Jun 17 13:23:35.150806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1655/3398] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:35.262264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:35.262878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:35.272005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.272602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.273691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.274172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.418997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:35.428462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0857a657-e589-4d42-8086-80cfcf9cfe66 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.170687 Jun 17 13:23:35.428950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:35.429212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1744/3399] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:35 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:35.431189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:35.438425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.438867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.439708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.440143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.512593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:35.521889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b9bba0d5-aeb4-49e6-aa9b-950255e33804 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096861 Jun 17 13:23:35.522497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1656/3400] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:36.169226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:36.169928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:36.176846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.177288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.178089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.178549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.317525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:36.321568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:36.328096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:36.329590 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:36.330754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b299f98c-dd5b-4ce9-9720-b1e6f647c09f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165776 Jun 17 13:23:36.331310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1745/3401] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:36.446610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:36.447758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:36.454866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.455308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.456127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.456555 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.539894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:36.541257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:36.547944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.548379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.549130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.549550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.603222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:36.611732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0aa7b7f2-ff18-4371-80ff-174f2c33e7e1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.169214 Jun 17 13:23:36.612322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1657/3402] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:36 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:36.617482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:36.626542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0ccb35c9-fbe6-4bbd-baa4-63ee5dff8eef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090831 Jun 17 13:23:36.627309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1746/3403] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:37.351979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:37.352755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:37.360163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.360601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.361361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.361810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.506029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:37.515196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:37.516735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:37.517905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ad3b1949-e6d4-4126-b91f-f3a0d34a22a3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171002 Jun 17 13:23:37.518487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1658/3404] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:37.631163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:37.631896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:37.640343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.640788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.641555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.641983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.645113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:37.645875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:37.653043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.653492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.654254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.654697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.723630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:37.733004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48e3a430-3d6e-4e20-9530-47abf077e76a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092073 Jun 17 13:23:37.733852 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1659/3405] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:37.801555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:37.810355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c2fb1493-346c-45fc-9906-146f52f3df84 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.183549 Jun 17 13:23:37.810943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1747/3406] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:37 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:38.537033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:38.538038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:38.545702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.546148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.546917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.547344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.687237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:38.696104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:38.697579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:38.699364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d5c107b9-8d53-4c1b-8de0-0afc7360b399 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166728 Jun 17 13:23:38.699956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1660/3407] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:38.754194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:38.755281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:38.758890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=78 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:38.765617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.766143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.766904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.767328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.828781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:38.829556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:38.835067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:38.836259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.836708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.837488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.837921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.843860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8cc96733-af11-41ee-9c60-a89f2a02fe73 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096347 Jun 17 13:23:38.844413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1748/3408] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:38.976592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:38.985091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6d0b7feb-bd59-4b35-906f-2cb8a726e66e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160614 Jun 17 13:23:38.985668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1661/3409] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:38 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:39.718263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:39.718911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:39.725358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:39.725804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:39.726564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:39.727000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:39.861743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:39.862392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:39.869274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:39.869715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:39.870475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:39.870994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:39.872128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:39.881330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:39.882819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:39.884010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e6feea4f-0826-490b-8ce6-d3cd6489d956 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170000 Jun 17 13:23:39.884567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1749/3410] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:39 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:39.936932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:39.946188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d74e8c87-a032-4238-b07a-aa0f216715e2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088426 Jun 17 13:23:39.946729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1662/3411] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:40.003012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:40.003639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:40.009918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.010386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.011129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.012274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.161986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:40.170399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b761cdd-e934-4c53-9eba-810b83ace15c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171299 Jun 17 13:23:40.171002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1750/3412] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:39 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:40.904155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:40.904758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:40.911466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.911911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.912666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.913097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.964993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:40.965632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:40.972484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.972911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.973694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.974114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:41.038256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:41.048318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3857e260-9ccd-4aad-8dac-1d66da6ce750 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087176 Jun 17 13:23:41.048876 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1751/3413] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:41.056953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:41.066236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:41.067771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:41.068962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7c78cd60-0ff1-4c7e-b3bd-a194e8cf7d59 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168857 Jun 17 13:23:41.069532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1663/3414] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:41.188824 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:41.189513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:41.196651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:41.197090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:41.197852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:41.198276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:41.343277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:41.351689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ba83a6cf-01f2-4534-9ca0-f34aa4e0e0bd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167365 Jun 17 13:23:41.352275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1752/3415] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:41 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:42.065544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:42.066183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:42.073181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.073633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.074386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.074822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.087025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:42.087615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:42.095614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.096066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.096831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.097264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.140073 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:42.148761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d5d3fa9d-5124-4b62-808a-dec2a5a2c602 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087120 Jun 17 13:23:42.149350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1664/3416] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:42.242187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:42.253559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:42.256058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:42.257918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-349b4f68-47eb-4658-9c20-1d7dccef6f6c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174548 Jun 17 13:23:42.258774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1753/3417] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:42.369626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:42.370230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:42.377943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.378383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.379133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.379593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.535332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:42.543691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b85e8dff-19b6-4f02-b85d-4c427b106348 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.177934 Jun 17 13:23:42.544235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1665/3418] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:42 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:43.166137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:43.166782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:43.174006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.174446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.175204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.175663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.242145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:43.251016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c238164a-0edc-4bd4-aed5-7f14e51cf1eb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088845 Jun 17 13:23:43.251611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1754/3419] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:43.282139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:43.282751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:43.290994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.291464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.292474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.292957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.443145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:43.455732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:43.457906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:43.459045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-522ef4e9-f3e6-4929-a057-734358934691 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.182588 Jun 17 13:23:43.459719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1666/3420] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:43.562284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:43.562937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:43.569647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.570090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.570857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.571273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.719746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:43.728487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-760df1fc-1bfa-409d-8aa5-aa1f69424aa8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.170843 Jun 17 13:23:43.729065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1755/3421] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:43 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:44.268946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:44.269548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:44.276507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.277591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.277909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.278345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.297454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:44.343528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:44.352316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8caf7cfe-3233-4e2b-8593-414fc0071920 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087535 Jun 17 13:23:44.352901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1667/3422] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:44 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:44.478673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:44.479258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:44.487022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.487492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.488576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.489030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.631405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:44.640633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:44.642137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:44.643309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d19074e2-f5f2-4984-b330-aad5c4cebfbe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168764 Jun 17 13:23:44.643902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1756/3423] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:44.746566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:44.747182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:44.753865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.754313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.755088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.755552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.895237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:44.904372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c777fc6d-c951-47f6-94d8-d6e13b59fdb8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161976 Jun 17 13:23:44.904951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1668/3424] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:44 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:45.370448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:45.370962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:45.377832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.378272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.379029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.379484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.442726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:45.451439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bdd03588-9b94-4a17-a3d5-98292c7a2bc3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084969 Jun 17 13:23:45.452060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1757/3425] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:45.662652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:45.663337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:45.670526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.670956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.671756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.672187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.816781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:45.826152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:45.827731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:45.828901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e0daac32-166d-491d-8060-23574b56803a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170421 Jun 17 13:23:45.829449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1669/3426] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:45.923331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:45.923957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:45.933304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.933752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.934523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.934957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.076279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:46.086041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-696a9fb7-4643-434b-9348-146bb4e30a6e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167751 Jun 17 13:23:46.086623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1758/3427] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:45 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:46.471407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:46.472294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:46.479917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:46.480369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.481135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:46.481571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.548872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:46.557426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e364cc5b-6f19-450c-b1e1-fa33dbc24c7e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092098 Jun 17 13:23:46.558003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1670/3428] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:46.847834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:46.848431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:46.855963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:46.856415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.857178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:46.857587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.991347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:47.000551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:47.002057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:47.003228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d9bc50cf-c324-40dc-8f5b-763e5e16ce4e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159750 Jun 17 13:23:47.003816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1759/3429] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:46 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:47.105902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:47.106806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:47.113629 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=80 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:47.116176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.116584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.117768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.117768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.264785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:47.274733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-274664cd-c7bf-4550-9930-123b6e647182 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173265 Jun 17 13:23:47.275697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1671/3430] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:47 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:47.575673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:47.576338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:47.583553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.583999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.584763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.585192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.656911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:47.665413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bd3c2f74-1beb-48f7-abc2-5829bcfae756 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094339 Jun 17 13:23:47.666027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1760/3431] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:48.025051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:48.025650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:48.033627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.034064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.034822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.035246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.178237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:48.187395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:48.188939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:48.190109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-07ecdcc5-38a2-4eab-bc62-cec5458b9721 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.171459 Jun 17 13:23:48.190694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1672/3432] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:48.294840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:48.295462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:48.302832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.303266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.304057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.304506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.454984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:48.466229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-841ab58f-f603-4fd1-8226-2e0ff35401b3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.176112 Jun 17 13:23:48.466963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1761/3433] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:48 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:48.684713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:48.685259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:48.692048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.692495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.693253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.693682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.762311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:48.771657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47267280-b007-4f4e-911d-fff13b5451b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091756 Jun 17 13:23:48.772231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1673/3434] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:49.210639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:49.211309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:49.218796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.219239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.220162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.220598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.241306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:49.363732 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:49.375255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:49.376913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:49.378079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5c60ca4a-8735-4e08-b3a0-bef505837f63 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173084 Jun 17 13:23:49.378631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1762/3435] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:49.486609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:49.487236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:49.494713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.495159 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.496075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.496393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.649137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:49.658475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1d017c73-eae1-438b-9685-e43f5e2901ea tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.176090 Jun 17 13:23:49.659336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1674/3436] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:49 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:49.791304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:49.792399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:49.799700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.800140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.800914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.801343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.875073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:49.886255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-176955d6-0c91-4c4d-bf7b-e7b4c566b201 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.100968 Jun 17 13:23:49.887006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1763/3437] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:50.398206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:50.398855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:50.405747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.406191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.406951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.407404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.547400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:50.556645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:50.558334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:50.560083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-59a4e846-9b93-4ac6-b819-95ba8b8d92f5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166846 Jun 17 13:23:50.560978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1675/3438] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:50.676569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:50.677247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:50.684019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.684835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.685313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.685730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.829196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:50.837491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4a2132ae-6c3c-48e3-adbd-91f07768ab41 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164954 Jun 17 13:23:50.838064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1764/3439] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:50 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:50.904205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:50.904809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:50.911399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.911931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.912683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.913107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.988904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:50.998776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a20ffaf9-07c9-4216-a09b-5c273bc496cb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098686 Jun 17 13:23:50.999347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1676/3440] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:51.580556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:51.581167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:51.587754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.588200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:51.588960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.589391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:51.721288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:51.730054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:51.731671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:51.732838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-95665fea-e7e1-4c67-a477-c437f7803239 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.156322 Jun 17 13:23:51.733398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1765/3441] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:51.855545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:51.856213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:51.863559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.864004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:51.864757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.865183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:51.997744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:52.006169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7aad1a44-170e-4cb6-8ecb-f94f76e502a1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154557 Jun 17 13:23:52.006732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1677/3442] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:51 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:52.016274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:52.017025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:52.023299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:52.023779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:52.024533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:52.024963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:52.089466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:52.097683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bdef170e-8eaf-4b99-8920-81182071f6f9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085376 Jun 17 13:23:52.098219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1766/3443] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:52.751924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:52.752561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:52.759100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:52.759582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:52.760338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:52.760809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:52.891630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:52.900228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:52.901734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:52.902854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2a6efceb-17fa-46f2-b570-cffac3f40b10 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.154927 Jun 17 13:23:52.903455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1678/3444] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:52 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:53.024248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:53.024810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:53.032356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.032834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.033591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.034022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.116441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:53.116441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:53.123143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.123624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.124398 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.124831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.166662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:53.175246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a962c38-5793-409f-a221-018d177ec7eb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154968 Jun 17 13:23:53.175841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1767/3445] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:53 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:53.190163 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:53.198375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e91a1cc-3933-4233-8f18-ecfe640aac82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087007 Jun 17 13:23:53.198941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1679/3446] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:53.921978 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:53.922574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:53.929286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.929726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.930478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.930928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.072787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:54.082292 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:54.083779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:54.084938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9eeed0ff-a99a-4102-a525-e80ead2c3af5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167106 Jun 17 13:23:54.085524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1768/3447] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:54.193572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:54.194097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:54.202150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.202952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.204461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.205282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.216216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:54.216829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:54.223092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.223580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.224357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.224790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.290755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:54.299527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1ca153d-dfe9-4416-a3ad-87ea2d0f5b17 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087109 Jun 17 13:23:54.300309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1769/3448] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:54.345615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:54.353849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a30c2202-4d80-4230-98dd-1b8d30f6137b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164323 Jun 17 13:23:54.354422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1680/3449] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:54 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:55.104588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:55.105219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:55.112413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.113266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.114059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.114487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.247891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:55.256362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:55.258104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:55.259252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1725dcb5-b8e2-49f6-ba49-45b71b4ab26e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.158718 Jun 17 13:23:55.259805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1770/3450] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:55.316777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:55.317351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:55.324401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.325118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.326083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.326514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.372010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:55.372574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:55.379001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.379478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.380230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.380655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.388925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:55.397174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0ff7fc28-8f9a-4e45-9a75-655a334de7b3 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084290 Jun 17 13:23:55.397756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1681/3451] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:55 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:55.512658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:55.520903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-232f7c5e-65ff-4c7b-a216-8fa6309da0bf tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153010 Jun 17 13:23:55.521471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1771/3452] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:55 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:56.278134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:56.278774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:56.285468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.285915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.286672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.287103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.414423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:56.415034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:56.422493 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.422873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.423666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.424097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.425326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:56.434293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:56.436272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:56.437440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-50608333-bb97-481c-bae5-b479da69d773 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163473 Jun 17 13:23:56.437980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1682/3453] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:56.489968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:56.498302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5a97342a-dd85-402b-bb47-65750db39cf8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087897 Jun 17 13:23:56.498863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1772/3454] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:56.656599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:56.657209 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:56.663536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.663962 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.664718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.665136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.797801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:56.807230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7726852f-25f0-4d29-8cd1-881af11b2d1f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.272789 Jun 17 13:23:56.807905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1683/3455] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:56 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:57.455648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:57.456245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:57.464362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.464803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.465817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.466369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.517080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:57.518294 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:57.526735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.527293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.528733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.529249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.534233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:57.595702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:57.603806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-391adf01-89d6-41d3-ba69-5c79ba75f72c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091881 Jun 17 13:23:57.604413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1684/3456] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:57.614459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:57.623543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:57.625082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:57.626277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ae7156a-193e-42a4-8b6f-2df9d03c93b7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174810 Jun 17 13:23:57.626831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1773/3457] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:57.830837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:57.831498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:57.837800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.838240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.839028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.839449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.980872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:57.990300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-23b1dbad-5750-4f40-b0bb-71deb85332b5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.163671 Jun 17 13:23:57.990904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1685/3458] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:57 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:58.623521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:58.624170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:58.631551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.631991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.632763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.633189 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.644542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:58.645358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:58.652231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.652663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.653560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.654094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.700050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:58.708623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c791cca7-de29-4b91-87ed-3e47ae9531f8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089571 Jun 17 13:23:58.709178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1774/3459] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:58 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:58.792871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:58.801943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:58.803469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:58.804679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-159b7cd6-0f14-42e2-9091-90fcc64c8892 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164097 Jun 17 13:23:58.805238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1686/3460] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:58 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:23:59.008726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:59.009331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:59.016309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.016749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.017509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.017933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.155666 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:59.164092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe88f916-e17d-4bf8-bc0e-4f09befc0a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.159368 Jun 17 13:23:59.164655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1775/3461] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:59 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:59.730574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:59.731980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:59.739240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.739727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.740553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.741047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.810235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:59.818823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f479d593-8852-4962-831a-7cd5fc81d01f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092188 Jun 17 13:23:59.819653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1687/3462] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:59 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:59.822877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:59.823502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:59.830770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.831201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.832016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.832450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.976548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:59.986280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:59.987727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:59.989241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4280d3fa-7fd5-472a-915e-87046c6ab94a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170656 Jun 17 13:23:59.989798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1776/3463] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:23:59 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:24:00.182576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:00.183185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:00.189821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.190268 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.191027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.191491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.333777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:00.342687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-974482d6-934c-4371-b315-60d52dc63dc2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164000 Jun 17 13:24:00.343269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1688/3464] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:00 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:00.837286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:00.837920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:00.847245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.847711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.848467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.848896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.916343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:00.925083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2da78e4f-41d8-4b53-bab9-bb230ed49c78 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091689 Jun 17 13:24:00.925669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1777/3465] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:00 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:01.008823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:01.009508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:01.016840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.017290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.018076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.018497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.152699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:01.161818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:01.163329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:01.164611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a6ddb2bb-b0e1-4714-93f9-09e91eae7581 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160367 Jun 17 13:24:01.165155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1689/3466] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:01 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:01.360636 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:01.361420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:01.368564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.368992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.369757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.370190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.510311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:01.519326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-65b7dfd6-21b9-4899-ab97-0c518b314d9f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162716 Jun 17 13:24:01.519961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1778/3467] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:01 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:01.945609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:01.946527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:01.954818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.955262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.956050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.956480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:02.021846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:02.030559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1e819ccc-113e-42c6-a2af-8bdf68f3a980 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091089 Jun 17 13:24:02.031160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1690/3468] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:01 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:02.184127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:02.184723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:02.192593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:02.193039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:02.193804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:02.194236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:02.198557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:02.331584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:02.341030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:02.342839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:02.344059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-34bb534d-7ad9-4bb3-8dfa-b1962349897d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164635 Jun 17 13:24:02.344624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1779/3469] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:02 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:02.537173 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:02.537782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:02.545523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:02.545938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:02.546716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:02.547147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:02.752766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:02.761212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a2b7046-45fc-4df3-8d2b-7e7f61f97da3 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.227957 Jun 17 13:24:02.761782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1691/3470] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:02 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:03.048712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:03.049323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:03.055867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.062921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.062921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.062921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.122374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:03.130986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-26bf90d0-80e8-4ae0-b99c-506fda248815 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086250 Jun 17 13:24:03.131598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1780/3471] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:03 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:03.364244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:03.364956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:03.371733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.372175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.373007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.373489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.525155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:03.534814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:03.536397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:03.537598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62f218ec-b568-44f3-be00-2187aef65170 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.178404 Jun 17 13:24:03.538361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1692/3472] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:03 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:03.782582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:03.783194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:03.790031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.790467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.791235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.791694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.021809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:04.030745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-81f265fa-adee-4fc5-bfa9-273efb685fb5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.252373 Jun 17 13:24:04.031583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1781/3473] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:03 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:04.148516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:04.149170 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:04.156214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:04.156582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.157356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:04.157788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.228983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:04.238542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b4295781-a098-4264-8511-39e6978f0bcb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093578 Jun 17 13:24:04.239118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1693/3474] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:04 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:04.557390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:04.557967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:04.565164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:04.565614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.566369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:04.566795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.711161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:04.720077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:04.721661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:04.722866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9fc6aeda-0c86-4cc3-9b39-5caa47ef426e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.170135 Jun 17 13:24:04.723586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1782/3475] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:04 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:05.049043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:05.049697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:05.057068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.057509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.058271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.058693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.209947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:05.218381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7004cfa9-572e-4b7f-920e-d08dc3d7980c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173790 Jun 17 13:24:05.219054 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1694/3476] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:05 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:05.259672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:05.260302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:05.268273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.268729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.269491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.269920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.335707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:05.346476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a1be599d-3fe3-427a-ba46-9dde786163c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090698 Jun 17 13:24:05.347052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1783/3477] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:05 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:05.743739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:05.744343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:05.751335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.757759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.757759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.757759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.895205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:05.904257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:05.905790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:05.907004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d3cc6973-cd63-4f94-bd16-3190c165efdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167332 Jun 17 13:24:05.907599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1695/3478] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:05 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:06.237136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:06.238098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:06.248543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.249167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.250284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.250793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.364597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:06.365228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:06.372562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.372910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.373711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.374164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.412000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:06.420720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e72c4c0a-4254-45ec-8f03-dcd632eb5a78 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.187573 Jun 17 13:24:06.421315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1784/3479] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:06 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:06.442880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:06.451334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4e9d3edf-a3e4-4fad-8cc7-6a717ed91d24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091245 Jun 17 13:24:06.451938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1696/3480] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:06 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:06.925368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:06.925881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:06.932632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.933080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.933856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.934257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.081658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:07.090627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:07.092210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:07.093384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7354716a-4481-4785-a1fa-04f686852802 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172300 Jun 17 13:24:07.093921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1785/3481] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:06 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:07.438796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:07.439480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:07.446155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.446593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.447356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.447796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.468856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:07.469516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:07.476844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.477297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.478126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.478560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.542698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:07.554568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e798045-3467-46cf-a803-63235517229b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089486 Jun 17 13:24:07.564693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1786/3482] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:07 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:07.597480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:07.606102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-acc021ff-aa6f-4d90-97c2-d8ef1a26c1db tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171449 Jun 17 13:24:07.606679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1697/3483] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:07 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:08.113726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:08.114722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:08.123250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.123871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.125047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.125508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.264151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:08.273253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:08.274843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:08.276034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ac02d0d1-080c-4994-99e8-02acd4116dce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.167410 Jun 17 13:24:08.276601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1787/3484] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:08 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:08.574022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:08.577235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:08.584905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.585345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.586108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.586535 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.624854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:08.625494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:08.633662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.634104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.634859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.635286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.653230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:08.665515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-19054804-5f23-4f9d-8091-752e3361fda2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.095012 Jun 17 13:24:08.666204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1698/3485] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:08 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:08.791551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:08.801939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fac2fbcb-548d-4baa-aa2b-efe50c0af35b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.180879 Jun 17 13:24:08.802518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1788/3486] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:08 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:09.296840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:09.297450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:09.304600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.305050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.305827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.306264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.445862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:09.455112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:09.456674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:09.457855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-540d6c9b-8264-43de-ae3f-1c63837499b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165156 Jun 17 13:24:09.458414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1699/3487] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:09 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:09.686668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:09.687265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:09.690155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=82 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:09.695808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.696260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.697021 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.697735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.765536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:09.777702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eb02f074-0f15-4775-86d0-8f1b893b60a1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.094863 Jun 17 13:24:09.778283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1789/3488] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:09 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:09.820194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:09.820851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:09.827991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.828456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.829192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.830228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.977415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:09.980946 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:09.986084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bae96bf4-96ca-4e30-b926-8d3dd7539e89 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.169786 Jun 17 13:24:09.986655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1700/3489] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:09 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:10.477431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:10.478225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:10.485330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:10.485849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:10.486730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:10.487150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:10.633361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:10.645472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:10.646946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:10.648157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-431c66ae-d74a-4f98-87db-f7504d3284cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.175295 Jun 17 13:24:10.648971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1790/3490] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:10 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:10.794719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:10.795461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:10.803579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:10.804018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:10.804775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:10.805198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:10.871261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:10.879922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-937b4a2a-6051-47fa-9328-5275b95ae34b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089234 Jun 17 13:24:10.880502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1701/3491] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:10 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:11.008649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:11.009313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:11.016534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.016986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.017783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.018218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.166829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:11.176245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7fd79b7e-832e-491a-abe6-8c6870940181 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171479 Jun 17 13:24:11.178941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1791/3492] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:11 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:11.670783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:11.671840 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:11.679155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.679653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.680418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.680853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.824259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:11.834493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:11.836047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:11.837207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0b476184-113b-460c-abfa-2c9456c7f9a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.172716 Jun 17 13:24:11.837757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1702/3493] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:11 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:11.896887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:11.897521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:11.904168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.904610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.905368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.905799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.976469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:11.984805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c4b9bdb6-7698-4f10-b6a1-0caa9d262f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091959 Jun 17 13:24:11.985391 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1792/3494] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:11 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:12.194975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:12.195636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:12.201920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.202363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.203131 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.203599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.347464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:12.356119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a0f85453-e834-4303-a4a8-5d14ffdbfb6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165343 Jun 17 13:24:12.356684 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1703/3495] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:12 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:12.857421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:12.858075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:12.867873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.868312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.869078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.869507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.004380 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:13.005005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:13.012475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.013065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.014129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.014795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.018489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:13.027418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:13.028909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:13.030071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f36165ef-819d-4fc6-be8a-f1ea3d49d653 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176773 Jun 17 13:24:13.030903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1793/3496] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:12 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:13.081184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:13.091994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-68ac2b95-a868-4677-a483-d1508e474d8c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091347 Jun 17 13:24:13.092666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1704/3497] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:12 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:13.374192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:13.374792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:13.382769 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.383174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.383988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.384407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.532687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:13.539096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-49d55f02-07f0-449f-b8a7-96a9ef8e16b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.168826 Jun 17 13:24:13.539723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1794/3498] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:13 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:14.049043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:14.049876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:14.056786 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.057224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.057976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.058425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.110863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:14.112226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:14.121098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.121553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.122334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.122768 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.189954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:14.193521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:14.199443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a7cbe45b-2e6b-4bcc-b646-cb49e99c7a94 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092717 Jun 17 13:24:14.199994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1795/3499] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:14 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:14.207040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:14.217311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:14.218937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:14.220328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c91c2c9d-812d-47f4-b9c8-08f9d3df8f90 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.175527 Jun 17 13:24:14.220892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1705/3500] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:14 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:14.556490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:14.557088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:14.564818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.565411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.566334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.566930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.711736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:14.720233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f5522b66-c9d3-4d87-addb-96b50c76c936 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167755 Jun 17 13:24:14.720841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1796/3501] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:14 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:15.219111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:15.219791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:15.229634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.230227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.231325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.231823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.239020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:15.239707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:15.246886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.247315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.248117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.248592 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.310445 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.322548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-187e6599-e119-4fa8-8dc3-c2d0ac3e85fa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.109461 Jun 17 13:24:15.323141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1706/3502] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:15 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:15.404146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.414020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.415563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.416875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-539cce97-29c8-4308-aa71-413bd370ae03 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.182396 Jun 17 13:24:15.417458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1797/3503] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:15 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:15.738516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:15.739045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:15.745809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.746525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.747505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.748192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.883925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.892483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5a84ecfe-98e2-48b6-a4b1-46837716b123 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.158322 Jun 17 13:24:15.893924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1707/3504] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:15 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:16.341416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:16.342053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:16.349562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.350371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.351149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.351618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.416691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:16.425746 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aedad3e2-cabc-4753-a712-07f31ba9d9da tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.088569 Jun 17 13:24:16.426337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1798/3505] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:16 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:16.436245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:16.436823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:16.444507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.444942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.445713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.446108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.600969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:16.610199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:16.611849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:16.613565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6ce6f31a-95ae-4002-8140-4a7e481e0fb8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.181358 Jun 17 13:24:16.614129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1708/3506] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:16 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:16.910418 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:16.911032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:16.917870 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.918339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.919108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.919626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.297311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.313873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-53202389-e0f0-43db-b50d-84bd89b8d09c tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.407362 Jun 17 13:24:17.314453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1799/3507] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:16 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:17.444237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:17.444988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:17.447256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=76 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:17.452867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.453314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.454074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.454509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.527346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.537227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a55ff564-9c4a-4cf4-9e20-2d91478c3a30 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097048 Jun 17 13:24:17.537845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1709/3508] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:17 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:17.633264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:17.634000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:17.641038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.641480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.642253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.642735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.781085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.790411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.791921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.793081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a91c7be6-1949-4f0b-a770-e92a1396239c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164026 Jun 17 13:24:17.793702 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1800/3509] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:17 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:18.332289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:18.333250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:18.339877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.340315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.341104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.341505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.493883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.502656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-154a3ee7-fdca-4da6-b6cd-b49dae88d503 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.174792 Jun 17 13:24:18.503243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1710/3510] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:18 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:18.555006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:18.555650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:18.562134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.562644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.563506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.563923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.632467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.641673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d09bdff7-89b2-4ad9-93b3-66761804c235 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090793 Jun 17 13:24:18.642333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1801/3511] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:18 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:18.811753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:18.812366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:18.819317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.819800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.820575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.821017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.964542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.973849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.975361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.976715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-631f9591-5824-405d-a25c-e7b14d5578c6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169061 Jun 17 13:24:18.977278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1711/3512] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:18 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:19.524958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:19.525535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:19.532050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.532511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.533271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.533851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.660442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:19.661257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:19.674460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.674955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.675875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.676576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.692488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:19.700976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f00ebcfe-1d2b-4c95-87a7-bd8916ce5321 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.180108 Jun 17 13:24:19.701558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1802/3513] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:19 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:19.743419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:19.752436 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2807058e-726c-454b-a471-0cc7a24a0c9f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.097247 Jun 17 13:24:19.753201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1712/3514] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:19 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:19.996291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:19.996943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:20.003691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.004153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.004939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.005369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.146608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.157683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.159162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.160556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9bd20a4d-9806-4e94-ba65-3ee4a2bf93dc tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.168373 Jun 17 13:24:20.161142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1803/3515] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:19 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:20.720202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:20.720856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:20.728098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.728581 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.729369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.729815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.771822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:20.772911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:20.780409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.781073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.782058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.782584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.848778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.857342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71bcc3e9-11f7-42dc-851e-36ea743685a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091136 Jun 17 13:24:20.857925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1804/3516] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:20 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:20.884026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.892245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f61f42fd-c2a0-4bec-a182-a38fc6086e6b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.177129 Jun 17 13:24:20.892845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1713/3517] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:20 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:21.178539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:21.179126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:21.189142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.189841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.190967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.191506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.332546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:21.341514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:21.343056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:21.344253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-135b632d-f77c-4ed2-b589-83947957a647 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.169816 Jun 17 13:24:21.344817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1805/3518] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:21 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:21.878592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:21.879263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:21.888654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.889242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.890197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.890644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.910269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:21.910900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:21.917828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.918332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.919043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.919512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.955960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:21.964818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aa414b4e-4661-4406-b9eb-fd583852f284 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091664 Jun 17 13:24:21.965439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1714/3519] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:21 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:22.059669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:22.075398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-417a6fda-055f-467f-9d00-b760b8c218e4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.168937 Jun 17 13:24:22.075987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1806/3520] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:21 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:22.363090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:22.363690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:22.370630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.371069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.371869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.372284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.520034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:22.529124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:22.530617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:22.532068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a9095a3e-7c3d-4833-9b95-4dd096735ac8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173216 Jun 17 13:24:22.532805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1715/3521] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:22 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:22.981614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:22.982254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:22.989649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.990092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.990853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.991294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.053810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.062950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-67b322ea-c3ba-4e00-a726-3265484881b0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085288 Jun 17 13:24:23.063549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1807/3522] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:22 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:23.093149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:23.093806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:23.101419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.101865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.102644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.103076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.249672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.258154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9d465a7e-91c8-49ee-9266-c5bf68242863 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.169015 Jun 17 13:24:23.258702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1716/3523] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:23 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:23.553036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:23.553561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:23.560099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.560538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.561285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.561712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.699285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.708669 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.710187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.711341 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5491cec8-59cd-465a-b16b-0ddb941b463b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162669 Jun 17 13:24:23.712003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1808/3524] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:23 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:24.080206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:24.080811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:24.087909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.088347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.089106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.089530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.109444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:24.156730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.165728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd1d538d-63f6-4c61-804f-ea097e229e62 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089297 Jun 17 13:24:24.166340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1717/3525] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:24 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:24.276157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:24.276801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:24.283481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.283968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.284737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.285161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.420054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.428935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9ebf8dd4-edde-4e79-ba5e-2ffd0f2d065f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156729 Jun 17 13:24:24.429484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1809/3526] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:24 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:24.730591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:24.731103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:24.738086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.738522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.739286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.739747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.873779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.882839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.884388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.885549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f081d56-4c36-488d-85c6-925b6106f307 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159078 Jun 17 13:24:24.886113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1718/3527] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:24 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:25.183413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:25.184139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:25.191264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.191880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.192648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.193083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.267274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:25.278068 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5c7a1734-ca85-4ab9-88a2-099eefc7c25d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.098529 Jun 17 13:24:25.278921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1810/3528] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:25 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:25.446777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:25.447345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:25.454389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.454822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.455641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.456076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.606990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:25.616356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-51765130-abad-454c-99a1-97454d0915c5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.173535 Jun 17 13:24:25.616978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1719/3529] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:25 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:25.904240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:25.904837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:25.911802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.912222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.916674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.917151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:26.055232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.064266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.065729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.066984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-513d0cd3-5fde-4315-bc32-8cb8a23faaa8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.166673 Jun 17 13:24:26.067561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1811/3530] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:25 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:26.295673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:26.296281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:26.303125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:26.303610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:26.304452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:26.304878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:26.367979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.376371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-059278d8-1462-4e7e-89b0-bd2c3c7ef43e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.084608 Jun 17 13:24:26.376937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1720/3531] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:26 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:26.634949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:26.635644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:26.642428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:26.642877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:26.643671 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:26.644102 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:26.663517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:26.783498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.792760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-72ac4d96-47c8-4e70-b0c2-347e975775b8 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161623 Jun 17 13:24:26.793361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1812/3532] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:26 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:27.086865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:27.087591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:27.094542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.094994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.095829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.096235 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.245238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.254343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.255944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.257126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7d87e5da-5a37-4f0b-801c-f38cc12e5d2f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174363 Jun 17 13:24:27.257716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1721/3533] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:27 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:27.394146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:27.394688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:27.401285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.401729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.402495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.402921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.470893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.480113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d69a7e5d-ee94-42be-94ca-2add0fdcbef2 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090123 Jun 17 13:24:27.480812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1813/3534] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:27 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:27.811482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:27.812113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:27.818955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.819391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.820194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.820625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.969232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.977823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-def467da-aea9-4617-ad02-f00a6ab88322 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.170357 Jun 17 13:24:27.978374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1722/3535] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:27 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:28.276300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:28.276897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:28.284047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.284489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.285325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.285933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.434250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:28.444043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:28.445588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:28.446782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f1b54fb-e9dc-4564-a4a8-2a02a423365b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.174520 Jun 17 13:24:28.447317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1814/3536] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:28 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:28.500126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:28.500722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:28.508089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.508524 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.509278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.509702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.581023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:28.589452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3a6ac45a-8586-4bb0-904a-fb33e44a0432 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093244 Jun 17 13:24:28.590019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1723/3537] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:28 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:28.996358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:28.997345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:29.009892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.010597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.011629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.012065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.150787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:29.159324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bf16f97f-0638-4a73-b2d7-831b22e54e20 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167902 Jun 17 13:24:29.159946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1815/3538] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:28 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:29.469965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:29.470737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:29.480236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.480904 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.482164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.482818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.607359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:29.607970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:29.615750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.616199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.616948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.617380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.625434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:29.637308 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:29.639037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:29.640241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-29b98e80-0c91-446b-9c02-878925008e12 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.176767 Jun 17 13:24:29.640788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1724/3539] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:29 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:29.684842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:29.694143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-538bb224-43a1-49af-8117-4867ca024dba tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090686 Jun 17 13:24:29.694714 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1816/3540] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:29 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:30.178444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:30.179075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:30.185466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.185905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.186659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.187087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.326139 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:30.337266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9f0e447e-7313-4e92-9cf6-dc53d73f313f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164767 Jun 17 13:24:30.337802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1725/3541] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:30 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:30.660569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:30.661440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:30.669012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.669453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.670224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.670645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.712199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:30.712827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:30.719710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.720155 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.720925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.721351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.799543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:30.807815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7127e86a-34fd-4949-96fd-6424e02e1bf4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099459 Jun 17 13:24:30.808393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1726/3542] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:30 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:30.809865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:30.818797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:30.820315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:30.821514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cb54b23a-7bd9-47d5-a9c5-b01748ba161e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.165012 Jun 17 13:24:30.822107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1817/3543] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:30 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:31.355900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:31.356504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:31.363430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.363899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.365532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.365970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.515213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.523728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd1b3452-e344-4683-912d-98621c5aaf82 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.171671 Jun 17 13:24:31.524371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1727/3544] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:31 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:31.825444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:31.826186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:31.833131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.833674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.834479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.834906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.840364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:31.840958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:31.847839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.848571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.849058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.849477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.905061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.914251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f333fc19-8c3e-4a39-8c5d-d9a030da500e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.092738 Jun 17 13:24:31.915146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1818/3545] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:31 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:31.984992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.996049 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.997546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.999441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c5e3d82b-2d0d-444f-966f-3cbd8039a19c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162758 Jun 17 13:24:32.000200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1728/3546] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:31 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:32.541360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:32.541991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:32.548694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.549130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.549883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.550321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.694875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:32.706551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d25a800f-93fa-41f8-82bb-c2fd687cb415 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.169076 Jun 17 13:24:32.707129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1819/3547] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:32 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:32.932801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:32.933668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:32.941584 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.942267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.943437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.944076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.008820 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.017299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-11edef97-2625-4350-b308-3cc70326efae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089079 Jun 17 13:24:33.017844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1729/3548] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:32 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:33.019740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:33.020349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:33.027489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.027940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.028706 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.029180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.177285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.186683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.188230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.189384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fa4f4ae8-0db7-4240-90fd-048ead57da97 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173529 Jun 17 13:24:33.189921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1820/3549] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:33 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:33.724355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:33.725015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:33.731545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.732000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.732756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.733186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.868701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.877298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-70ed9b55-e5ab-4108-b2c8-df99811a969e tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.156902 Jun 17 13:24:33.877881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1730/3550] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:33 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:34.034980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:34.035638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:34.042899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.043340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.044132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.044558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.108153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:34.117515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-243231ca-3544-43cf-aad6-02c58ee50b09 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086096 Jun 17 13:24:34.117833 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1821/3551] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:34.208309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:34.208879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:34.215985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.216423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.217178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.217605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.354371 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:34.363753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:34.365273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:34.366435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8bb70e45-ee2a-42e2-b6d8-3a1ec01831f2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162268 Jun 17 13:24:34.367005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1731/3552] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:34 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:34.895245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:34.895882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:34.902534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.902986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.903780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.904211 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.037544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:35.046226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b38525d6-75bf-48ce-9667-0ac6481abdd4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154914 Jun 17 13:24:35.046798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1822/3553] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:34 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:35.134571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:35.135184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:35.141882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.142329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.143080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.143575 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.205353 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:35.214157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fe15071c-b24c-4793-a6d5-2b6d24470e36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.083692 Jun 17 13:24:35.214811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1732/3554] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:35 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:35.385501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:35.386104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:35.392850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.393291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.394049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.394480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.530044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:35.539147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:35.540672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:35.541842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eaddc8f2-d325-4734-9d95-82702d80bc8f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160697 Jun 17 13:24:35.542401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1823/3555] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:35 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:36.064042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:36.064661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:36.071706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.072152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.072927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.073367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.218202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.227190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-00f74fe5-984e-477d-b008-305a9cb2f165 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.167093 Jun 17 13:24:36.227817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1733/3556] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:36 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:36.232150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:36.232765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:36.240300 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.241233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.242168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.242617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.305531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.313468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-363bb359-85e2-45cf-81ec-efd9ab0aca7c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085271 Jun 17 13:24:36.314026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1824/3557] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:36 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:36.560484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:36.561086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:36.567705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.568143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.569014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.569443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.573716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:36.706875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.716041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.717567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.718749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-267e8e2b-8459-426a-a4ba-00d06d94c0f0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162325 Jun 17 13:24:36.719281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1734/3558] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:36 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:37.244315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:37.244949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:37.252112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.252557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.253318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.253752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.332143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:37.332732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:37.340245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.340709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.341480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.341903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.394388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.403089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3bbacb20-20c9-4cec-9200-9bd5b1f225fc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.162732 Jun 17 13:24:37.403820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1825/3559] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:37 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:37.409476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.418008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fd6e3f76-b9ed-4ca6-bd1c-d0ba6f37fb3d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089828 Jun 17 13:24:37.418615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1735/3560] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:37 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:37.738067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:37.738570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:37.745328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.745771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.746526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.746955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.883393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.892154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.893609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.894759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8012e4ad-d817-4eb2-a398-7aab1cf03c93 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161244 Jun 17 13:24:37.895338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1826/3561] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:37 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:38.421810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:38.422422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:38.429508 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.429970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.430735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.431345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.434911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:38.435560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:38.442487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.442936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.444256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.444256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.508932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:38.517360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-09fce587-dc3d-4821-a8ae-b5665402ac5d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086280 Jun 17 13:24:38.517941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1827/3562] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:38 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:38.566007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:38.574831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5954054d-0a9b-4e8a-a96e-c74bd332a78f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157062 Jun 17 13:24:38.575397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1736/3563] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:38 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:38.913760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:38.914461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:38.921052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.921502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.922266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.922700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.058393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.067232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.068771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.069916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-83f773cf-e828-46b4-9000-1891e0739949 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160396 Jun 17 13:24:39.070502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1828/3564] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:38 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:39.536046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:39.536858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:39.545242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.545690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.546455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.546889 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.594683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:39.595437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:39.604149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.604585 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.605334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.605750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.610816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:39.618409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.627123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9e319caa-4457-402d-b56f-cd6bf5f32a68 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.096180 Jun 17 13:24:39.627834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1737/3565] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:39 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:39.740980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.754207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7172880f-92a4-468e-98d1-f5c7b7c6b73f tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165174 Jun 17 13:24:39.755077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1829/3566] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:39 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:40.088645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:40.089247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:40.096530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.097319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.098557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.099279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.235863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:40.245291 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:40.246807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:40.248012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-72ab78a7-5656-4966-8aff-e5a5f4a65009 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163368 Jun 17 13:24:40.248578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1738/3567] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:40 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:40.647259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:40.647917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:40.650235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=82 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:40.656016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.656460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.657226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.657663 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.727163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:40.735846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c5ce95da-fef6-4871-87e9-1b1a83ca391f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.093849 Jun 17 13:24:40.736420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1830/3568] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:40 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:40.776477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:40.777102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:40.784057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.784495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.785274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.785707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.920288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:40.928888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-126b833c-67fa-49db-8164-c0a23cc5ecba tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157025 Jun 17 13:24:40.929442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1739/3569] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:40 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:41.266977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:41.267598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:41.274628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.275063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:41.275867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.276291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:41.406312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:41.415355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:41.416871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:41.418026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0bdd7f5e-c13c-47ba-98c6-a804c33d88a0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.155058 Jun 17 13:24:41.418561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1831/3570] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:41.753910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:41.754540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:41.761494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.761935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:41.762689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.763116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:41.832831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:41.837669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-23e592a1-dd54-4dda-9c90-45b3e2810997 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087774 Jun 17 13:24:41.838242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1740/3571] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:41 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:41.946734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:41.948052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:41.955103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.955568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:41.956317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.956890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.088384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.096634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0a0d0014-329e-4ddb-8eb8-4665f17402f0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.154174 Jun 17 13:24:42.097206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1832/3572] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:41 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:42.437550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:42.438190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:42.445357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.445804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.446586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.447021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.597702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.612977 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.615654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.617566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7ad78101-aca3-4a61-90b6-8d32c3d3a2f3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.183820 Jun 17 13:24:42.618477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1741/3573] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:42 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:42.856373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:42.856899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:42.863526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.863964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.864710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.865137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.933412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.942024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-271dc8fe-9609-481a-94e0-99cf8dc50fa0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089686 Jun 17 13:24:42.942599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1833/3574] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:42 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:43.114844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:43.115503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:43.122906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.123346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.124134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.124557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.263692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:43.272343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-537c57a8-446f-448f-8784-9fa76ec5e75d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161930 Jun 17 13:24:43.272982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1742/3575] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:43 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:43.636712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:43.637358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:43.644489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.644938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.645700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.646132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.781621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:43.791310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:43.792818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:43.793981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-93365760-ee66-4eaf-9f18-47342d65ddaf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.161321 Jun 17 13:24:43.794526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1834/3576] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:43 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:43.959844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:43.960233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:43.967008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.967509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.968276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.968706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.032601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.041529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0afcd30f-8041-4b6c-9f31-c4d9c9e611db tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085929 Jun 17 13:24:44.042111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1743/3577] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:43 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:44.290072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:44.290677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:44.297380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.297819 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.298566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.298988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.432967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.441604 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e924374-6de1-4891-b204-54fe198053c1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.155391 Jun 17 13:24:44.442188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1835/3578] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:44 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:44.813569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:44.814203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:44.821265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.821830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.822602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.823029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.960406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.978621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.980678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.982779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1808527c-0090-4af0-a035-3331f371c27c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.173148 Jun 17 13:24:44.983827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1744/3579] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:44 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:45.059853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:45.060475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:45.067727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.068084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.069410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.069561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.137020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:45.145586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6e0b50ed-6b31-4d6a-b532-2f99cc30f95f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.089756 Jun 17 13:24:45.146157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1836/3580] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:45 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:45.459902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:45.460424 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:45.466991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.467439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.468229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.468661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.600528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:45.609232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-595c8176-140c-4664-9e2b-9f3649a0abe1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153477 Jun 17 13:24:45.609790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1745/3581] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:45 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:46.004166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:46.004770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:46.011645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.012090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.012844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.013270 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.147686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:46.156750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:46.158269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:46.159471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2b88cbe-62f3-4a5d-8139-82407a707040 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159286 Jun 17 13:24:46.160028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1837/3582] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:45 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:46.163532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:46.164148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:46.171075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.171551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.172316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.172742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.235980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:46.244993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0262e5ea-30b1-499d-8be3-23783b218b83 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085696 Jun 17 13:24:46.245558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1746/3583] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:46 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:46.627642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:46.628285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:46.635014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.635494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.636261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.636701 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.773090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:46.781643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cd4fcb3c-0a0a-4598-9e11-4ff881987215 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157942 Jun 17 13:24:46.782213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1838/3584] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:46 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:47.178502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:47.179144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:47.186347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.186760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.187704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.188136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.262611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:47.264058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:47.271205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.271766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.272601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.273027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.326017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.335656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.337232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.338788 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-086442a3-12e8-4a71-8270-d6e273b24b29 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.164029 Jun 17 13:24:47.339009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1747/3585] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:47 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:47.340887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.350027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6b8e34dc-541f-4ab4-aa4f-fdcced6979b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091075 Jun 17 13:24:47.350822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1839/3586] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:47 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:47.799510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:47.800123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:47.802039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=78 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:47.807707 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.808152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.808912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.809345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.940200 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.948396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-77256ada-e474-4ef1-b73e-c3b82909e015 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153056 Jun 17 13:24:47.948960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1748/3587] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:47 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:48.357419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:48.358037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:48.365476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.366038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.366750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.367119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.368218 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:48.368825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:48.375582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.376021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.376759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.377190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.440164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:48.449020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cbbd4340-040f-40df-8f63-4493b01b809e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085319 Jun 17 13:24:48.449753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1749/3588] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:48 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:48.504893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:48.513748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:48.515253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:48.516448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-afba9e0a-1255-4720-b34c-2a0e03f2a057 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.163027 Jun 17 13:24:48.517018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1840/3589] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:48 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:48.966067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:48.966717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:48.973364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.973841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.974815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.975243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.119214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.122799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:49.127972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dd8db1d2-118a-4277-b8bc-8ac4c148e049 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165766 Jun 17 13:24:49.128547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1750/3590] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:48 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:49.466499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:49.467141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:49.474345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.474837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.475660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.476098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.534428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:49.535072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:49.539403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.544992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.545437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.546212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.546642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.548118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-42b9e788-a44c-4bca-8578-9b295d049f56 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.085624 Jun 17 13:24:49.548707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1841/3591] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:49 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:49.678677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.688201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.689694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.690892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f4df8632-3466-4874-b461-3858dd0b3604 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160535 Jun 17 13:24:49.691514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1751/3592] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:49 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:50.146079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:50.147362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:50.153877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.154313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.155059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.155521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.298805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:50.307423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1fc0290-74b4-4993-a295-1b35031b77bb tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.165266 Jun 17 13:24:50.308028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1842/3593] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:50 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:50.565853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:50.566510 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:50.573757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.574208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.574973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.575402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.651844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:50.661494 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8817e5fa-d57f-4cb1-b99b-bbc7f7e3a015 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.099519 Jun 17 13:24:50.662241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1752/3594] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:50 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:50.709932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:50.710562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:50.717283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.717724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.718469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.718889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.853879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:50.862984 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:50.864584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:50.865976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a1ffa418-5566-4fc4-a734-acf2fe1e2cdf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.160462 Jun 17 13:24:50.866521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1843/3595] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:50 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:51.324183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:51.324804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:51.331402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.331870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.332633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.333065 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.463877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:51.472406 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9fc0920c-63e5-4927-99a7-37a70ae481a4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.152101 Jun 17 13:24:51.472981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1753/3596] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:51 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:51.679503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:51.680044 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:51.686715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.687133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.687919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.688348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.752613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:51.761632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-203affb7-00ed-40f5-b0c7-82fb67373b14 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086160 Jun 17 13:24:51.762223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1844/3597] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:51 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:51.884792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:51.885381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:51.892447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.892888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.893652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.894087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.027417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.036193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.039892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.040085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-24f3608d-fa88-47a3-8b51-537a464901a1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159265 Jun 17 13:24:52.040656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1754/3598] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:51 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:52.491843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:52.492455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:52.499127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:52.499607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.500380 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:52.500814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.637575 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.641134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:52.647072 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c4e35411-5869-4172-a1f2-d4ff31219f69 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.160412 Jun 17 13:24:52.647685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1845/3599] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:52 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:52.779199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:52.779729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:52.786280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:52.786721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.787479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:52.787938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.852726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.861258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f8390d9c-ab60-47f7-8705-0103849d9c3c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.086009 Jun 17 13:24:52.862223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1755/3600] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:52 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:53.065556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:53.066124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:53.073156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.073600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.074359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.074795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.207668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.217564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.219049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.220243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4a816d5b-57b4-4d87-9607-1095fd3bc3ba tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159028 Jun 17 13:24:53.220798 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1846/3601] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:53 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:53.664921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:53.665593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:53.672779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.673240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.674008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.674440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.805656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.814246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-12020663-ec75-4030-af4b-e090eaee615a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.153480 Jun 17 13:24:53.814823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1756/3602] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:53 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:53.879667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:53.880296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:53.887733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.888168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.888912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.889342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.954220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.962925 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e99ee129-0539-4dd7-971a-296458ad07e6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.087890 Jun 17 13:24:53.963508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1847/3603] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:53 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:54.238864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:54.239400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:54.246197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.246646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.247405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.247873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.381669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:54.391269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:54.392930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:54.394077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8025e6c6-63e9-4d44-8a19-7a1d8e2ff159 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.159681 Jun 17 13:24:54.394610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1757/3604] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:54 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:54.832000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:54.832712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:54.839795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.840234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.840996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.841415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.980222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:54.980438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:54.980851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:54.988262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.988709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.989239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-df47bb6b-2fce-41aa-875c-6d0d693d8230 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.161130 Jun 17 13:24:54.989467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.989816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1848/3605] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:54 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:54.989941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:55.058778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:55.067239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-02032d50-6775-4875-9d7e-3abead623b3e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.090905 Jun 17 13:24:55.067850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1758/3606] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:54 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:55.413078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:55.413553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:55.419912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:55.420356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:55.421136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:55.421599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:55.559414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:55.568390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:55.570245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:55.571407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-409e3fec-91c8-4de7-8a6f-570474509b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.162504 Jun 17 13:24:55.571961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1849/3607] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:55 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:56.007646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:56.008277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:56.015262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.015743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.016505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.016930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.084299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:56.084932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:56.091755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.092194 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.092960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.093390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.152547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.160980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d7181c4a-94ae-4e06-b09a-8c03ea35aa61 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.157581 Jun 17 13:24:56.161531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1759/3608] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:56 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:56.163062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.171581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d22a63f1-e946-4211-b1fd-0a7974e33e87 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.091166 Jun 17 13:24:56.172143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1850/3609] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:56 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:56.681561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:56.682189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:56.688539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.688997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.689766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.690199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.825282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.835540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.837214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.838466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e439729e-bf11-4666-841c-bdfa760b167d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.252825 Jun 17 13:24:56.839036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1760/3610] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:56 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:57.179251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:57.179916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 067c508e-8040-41dd-bc09-07434f2ed0af] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:57.187180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.188309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.189114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.189558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.285005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:57.285613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:57.292791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.293225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.293990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.294416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.329953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:57.339397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3dfa27b8-7fda-4234-b013-d348b6039274 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af" status: 200 len: 1559 microversion: 2.1 time: 0.164481 Jun 17 13:24:57.340027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1851/3611] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:57 2022] GET /compute/v2.1/servers/067c508e-8040-41dd-bc09-07434f2ed0af => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:57.363808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:57.372129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f2c837c8-bd98-478f-b80f-12ded11ee282 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 200 len: 1372 microversion: 2.1 time: 0.186747 Jun 17 13:24:57.372741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1761/3612] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:57 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:57.390123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7aafc69e-eb9c-40b0-9ed3-1c96e46dec0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '.version_select at 0x7f45530b8dc0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:57.393698 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7aafc69e-eb9c-40b0-9ed3-1c96e46dec0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [e578b280-b4d0-48fd-af7f-084e926e07ca] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:24:57.857453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:57.858147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:57.865790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.866175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.867037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.867513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.036232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.047743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.049622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.050901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ded63bf2-d7ff-445b-b667-d8552c86bc39 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 200 len: 1803 microversion: 2.20 time: 0.197571 Jun 17 13:24:58.051753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1762/3613] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:24:57 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 1803 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:24:58.059178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.059928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:58.066596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.067156 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.068121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.069051 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.096719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:24:58.196623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ae747ec3-6711-4188-b799-2a386e803c9b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 204 len: 0 microversion: 2.1 time: 0.143294 Jun 17 13:24:58.199116 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1763/3614] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:24:58 2022] DELETE /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:24:58.207039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.207733 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:58.214284 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.214719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.215501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.215907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.244507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:24:58.282517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:58.326595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1893cff5-4566-4b0d-ba61-0b4729f0eff1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 204 len: 0 microversion: 2.1 time: 0.125710 Jun 17 13:24:58.327502 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1764/3615] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:24:58 2022] DELETE /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:24:58.336231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3c28a78c-7db8-4d1e-847b-69a028300b74 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '.version_select at 0x7f454e8c3430>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.339545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c28a78c-7db8-4d1e-847b-69a028300b74 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [5d67c96a-b21c-417f-bfa7-bfb1c4332730] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:24:58.402030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [None req-7aafc69e-eb9c-40b0-9ed3-1c96e46dec0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [e578b280-b4d0-48fd-af7f-084e926e07ca] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 54406. Jun 17 13:24:58.423555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7aafc69e-eb9c-40b0-9ed3-1c96e46dec0f tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312277092" status: 202 len: 0 microversion: 2.1 time: 1.037514 Jun 17 13:24:58.424143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1852/3616] 10.222.0.87 () {58 vars in 1220 bytes} [Fri Jun 17 13:24:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312277092 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:24:58.429146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.429789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:58.438427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.438904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.439801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.440329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.584002 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.593481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8782cad8-e130-4b1a-b500-fc611c42c8a9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1719 microversion: 2.1 time: 0.168296 Jun 17 13:24:58.594541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1853/3617] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:58 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:58.599811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.600437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:58.609140 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.609777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.610806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.611235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.871096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.879755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3dc40458-9a53-472b-9fa8-fe06ebf05045 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.283732 Jun 17 13:24:58.880328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1854/3618] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:58 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:59.347231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c28a78c-7db8-4d1e-847b-69a028300b74 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [5d67c96a-b21c-417f-bfa7-bfb1c4332730] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 54414. Jun 17 13:24:59.368649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3c28a78c-7db8-4d1e-847b-69a028300b74 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401143179" status: 204 len: 0 microversion: 2.20 time: 1.037014 Jun 17 13:24:59.369272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1765/3619] 10.222.0.87 () {60 vars in 1261 bytes} [Fri Jun 17 13:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401143179 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 13:24:59.617830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:59.619257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:59.635313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.635313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.639851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.643287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.647067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f2a2b4a3-c0e7-4cd0-bf7e-86d12843b267 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: .version_select at 0x7f4553170550>, body: {"keypair": {"name": "tempest-keypair-1733023356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWSsiBUEuS3AtEb//BhzgGv8d16y+FGdCtzaMJwz/2UJIw6VEzvw0gVJ+zXx+eAp/nPNUxRsp4Gv9bd/4TYPjnfOyNaLdmoom46MUGe7UP2r3fDvP7khuEl1GGQwvFrJw=="}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:24:59.682196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-f2a2b4a3-c0e7-4cd0-bf7e-86d12843b267 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:24:59.694815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-f2a2b4a3-c0e7-4cd0-bf7e-86d12843b267 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:24:59.729674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f2a2b4a3-c0e7-4cd0-bf7e-86d12843b267 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087612 Jun 17 13:24:59.735837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1766/3620] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 13:24:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:24:59.767339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:59.790853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bbc096e1-e0b5-4002-9f46-3980566a9042 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1652 microversion: 2.1 time: 0.181987 Jun 17 13:24:59.793937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1855/3621] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:59 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1652 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:59.899515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:59.900692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:59.909330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.910627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.911435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.912246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:00.132013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:00.145208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a80874ee-5689-4745-821a-1d77b63cb044 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.246896 Jun 17 13:25:00.145851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1767/3622] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:00.589980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-4d613ec5-119a-4d42-b687-6686f20fde99 req-aea86499-a8da-4d98-88ff-16140786b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e80959-0f5b-4f32-934a-f939416afe0a", "name": "network-vif-deleted", "tag": "1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:00.599442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4d613ec5-119a-4d42-b687-6686f20fde99 req-aea86499-a8da-4d98-88ff-16140786b0a0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:00.600025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4d613ec5-119a-4d42-b687-6686f20fde99 req-aea86499-a8da-4d98-88ff-16140786b0a0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:00.612373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-4d613ec5-119a-4d42-b687-6686f20fde99 req-aea86499-a8da-4d98-88ff-16140786b0a0 service nova] Creating event network-vif-deleted:1c65ab92-306b-4cd6-a55f-cc7e4d7a9c22 for instance 57e80959-0f5b-4f32-934a-f939416afe0a on hv-cinder-84617 Jun 17 13:25:00.618607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-4d613ec5-119a-4d42-b687-6686f20fde99 req-aea86499-a8da-4d98-88ff-16140786b0a0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160711 Jun 17 13:25:00.619989 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1856/3623] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:00.845895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:00.848262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:00.878303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:00.880317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:00.882244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:00.900824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:01.050987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-a8a1a164-d8c7-447f-9d03-4e15a682e0b8 req-0fe88ad7-370d-4712-9926-cd004eb3ce0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:01.053701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:01.061774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-a8a1a164-d8c7-447f-9d03-4e15a682e0b8 req-0fe88ad7-370d-4712-9926-cd004eb3ce0f service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:01.064345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e7e126a7-6633-49f7-b9f2-78aec20b872f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.257514 Jun 17 13:25:01.064941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1768/3624] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:01.073568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-a8a1a164-d8c7-447f-9d03-4e15a682e0b8 req-0fe88ad7-370d-4712-9926-cd004eb3ce0f service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:01.085210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a5763b2c-2c01-4e72-a3c1-a2eb87350ca4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'create', calling method: .version_select at 0x7f45531350d0>, body: {"keypair": {"name": "tempest-keypair-244312069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjEBnZsGeYZfpvytjDorhnlLbrGDIhgpr9KbSe0Ze2g704rGfiSHiff1ouQnheuRrFdEnz8fq3I25QrAWBcjxk6ID+d8zKAXJheQwgvu9kBoeG64MOO7NiyG0g1HCK+Ww=="}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:01.089956 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-a8a1a164-d8c7-447f-9d03-4e15a682e0b8 req-0fe88ad7-370d-4712-9926-cd004eb3ce0f service nova] Creating event network-changed:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 13:25:01.102657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-a5763b2c-2c01-4e72-a3c1-a2eb87350ca4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:25:01.105705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-a8a1a164-d8c7-447f-9d03-4e15a682e0b8 req-0fe88ad7-370d-4712-9926-cd004eb3ce0f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284330 Jun 17 13:25:01.106802 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1857/3625] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:01.108277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-a5763b2c-2c01-4e72-a3c1-a2eb87350ca4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for user a14c1230233e43789087e9239ffb91e2 and project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:25:01.164757 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:01.165659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:01.173568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a5763b2c-2c01-4e72-a3c1-a2eb87350ca4 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.098399 Jun 17 13:25:01.174296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1769/3626] 10.222.0.87 () {62 vars in 1199 bytes} [Fri Jun 17 13:25:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 13:25:01.183327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:01.184309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:01.185395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:01.186064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:01.444591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:01.456276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-83517f33-33a2-4568-80b3-0f6564cadf97 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.297391 Jun 17 13:25:01.456871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1858/3627] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:02.088887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:02.089665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:02.096401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.096934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.097802 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.098341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.201182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:02.210604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-acaaddba-684e-43cc-b506-2d20dd2449e6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.126354 Jun 17 13:25:02.211192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1770/3628] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:02.473981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:02.474758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:02.481810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.482222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.483020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.483474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.659025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:02.661531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1373335294", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63451fcb-248d-4063-92cc-62a9c2c4e98f"}], "security_groups": [{"name": "tempest-securitygroup--157856012"}], "key_name": "tempest-keypair-1733023356", "user_data": "}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:02.668015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-67a9240d-1ec9-4527-9fd4-e1fc35ea13ad tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.197905 Jun 17 13:25:02.668712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1859/3629] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:02 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:02.823456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] validate_networks() for [('63451fcb-248d-4063-92cc-62a9c2c4e98f', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:25:03.228259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:03.228778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:03.235039 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.235517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.236242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.237228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.305274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:03.313681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c769686-e9de-49c1-9b26-27e89832e928 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089398 Jun 17 13:25:03.314318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1860/3630] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:03.421054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-497340608", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be305ded-f559-45bc-94a4-3366ddb58607"}], "security_groups": [{"name": "tempest-securitygroup--209569905"}], "key_name": "tempest-keypair-244312069", "user_data": "}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:03.469212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:25:03.469745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:25:03.470316 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:25:03.470772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:25:03.471239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:25:03.480696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.481056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.481856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.482288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.500248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:25:03.504347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:25:03.515901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:25:03.518194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:25:03.525872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] validate_networks() for [('be305ded-f559-45bc-94a4-3366ddb58607', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:25:03.565640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48a2b4f4-2f80-4c42-a705-0ab79f98d21d tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.908318 Jun 17 13:25:03.571557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1771/3631] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 13:25:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:25:03.576876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-19fde907-d2a9-42bd-b721-e6b36f5b2340 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:03.577542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-19fde907-d2a9-42bd-b721-e6b36f5b2340 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:03.585516 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:03.645766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-19fde907-d2a9-42bd-b721-e6b36f5b2340 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:03.653273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-19fde907-d2a9-42bd-b721-e6b36f5b2340 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1242 microversion: 2.1 time: 0.080386 Jun 17 13:25:03.653856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1772/3632] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:03 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:03.685744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:03.686556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:03.692744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.693464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.694248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.694688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.864095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:03.877228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-eb6a6355-c490-493d-b4c7-57bd7cb73e65 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.195438 Jun 17 13:25:03.877806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1773/3633] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:04.055911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:25:04.056608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:25:04.057106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:25:04.057503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:25:04.057905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:25:04.069064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.069517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.070602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.071070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.091109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:25:04.096222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Getting quotas for user a14c1230233e43789087e9239ffb91e2 and project b3495f3daaa44dc9b20a08f3e1128bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:25:04.109972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:25:04.112817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:25:04.180327 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-73b28e7a-f055-403b-bcac-b89574ff6811 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.763631 Jun 17 13:25:04.193623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c1ff0212-1050-4a29-a652-f2e38f3f01ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:04.194332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c1ff0212-1050-4a29-a652-f2e38f3f01ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:04.198091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1861/3634] 10.222.0.87 () {62 vars in 1187 bytes} [Fri Jun 17 13:25:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 13:25:04.268967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c1ff0212-1050-4a29-a652-f2e38f3f01ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.279469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c1ff0212-1050-4a29-a652-f2e38f3f01ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.288593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c1ff0212-1050-4a29-a652-f2e38f3f01ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.289740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c1ff0212-1050-4a29-a652-f2e38f3f01ae tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1280 microversion: 2.20 time: 0.101369 Jun 17 13:25:04.290302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1774/3635] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:04 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:04.330835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:04.331692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:04.341323 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.341760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.342526 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.343016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.421013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.434751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-59530359-5f2d-4ea5-8558-55d7d2c0ce52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.107020 Jun 17 13:25:04.440145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1862/3636] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:04.670717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:04.671323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:04.678942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.679400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.680169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.680600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.744269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.751846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4dfa12be-4605-4b65-8a37-87ba830d72ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1294 microversion: 2.1 time: 0.084942 Jun 17 13:25:04.752428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1775/3637] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:04 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:04.894622 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:04.895196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:04.903157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.904071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.905143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.905785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.131453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:05.142831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8a2cfb44-8c7c-4ca8-8083-10beb58f378b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.252196 Jun 17 13:25:05.143462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1863/3638] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:05.308827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:05.309450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:05.316636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.317087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.317881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.318328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.385267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:05.394964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:05.397228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:05.398349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b97ebfd8-e63c-4905-b2eb-32587daf3933 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1332 microversion: 2.20 time: 0.093591 Jun 17 13:25:05.402189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1776/3639] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:05 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:05.452382 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:05.453202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:05.461051 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.461452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.462264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.462697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.539020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:05.547621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d3564471-713a-4566-84db-6d49088f4092 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.099205 Jun 17 13:25:05.548481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1864/3640] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:05.770000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:05.770766 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:05.777560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.787742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.788771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.789324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.875178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:05.883556 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5bce1585-4d8a-4a84-9dd5-4abe72c4a88c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1300 microversion: 2.1 time: 0.117476 Jun 17 13:25:05.884138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1777/3641] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:05 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:06.164085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:06.165764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:06.172462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.173197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.174145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.174812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.208036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:06.417357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:06.418715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:06.425317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.425890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.426916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.427519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.441816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.455686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-033e08cd-7b35-411b-81ec-d374066535b4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.298383 Jun 17 13:25:06.466193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1865/3642] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:06 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:06.500988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.511083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.512814 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.514978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f7c3704-38b1-47a4-a849-3e822432fe82 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1338 microversion: 2.20 time: 0.101590 Jun 17 13:25:06.515689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1778/3643] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:06 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:06.566515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:06.567472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:06.574425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.574877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.575692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.576132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.707539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.717411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eb2f29aa-67c7-4764-97e4-7cafffd2a62b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.154767 Jun 17 13:25:06.728630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1866/3644] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:06.902043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:06.902653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:06.909916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.910696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.912007 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.912881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.956999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-243df4ac-663e-496f-83f3-af396d5517ca req-582531a2-1bcf-4c13-9b4e-dcf798bc42da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4faf5d-3bec-46ab-8038-57b814a30b3c", "tag": "0c85e2cd-3002-4a63-898c-cf35574100c1"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:06.976195 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-243df4ac-663e-496f-83f3-af396d5517ca req-582531a2-1bcf-4c13-9b4e-dcf798bc42da service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.978953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-243df4ac-663e-496f-83f3-af396d5517ca req-582531a2-1bcf-4c13-9b4e-dcf798bc42da service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.994648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-243df4ac-663e-496f-83f3-af396d5517ca req-582531a2-1bcf-4c13-9b4e-dcf798bc42da service nova] Creating event network-changed:0c85e2cd-3002-4a63-898c-cf35574100c1 for instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c on hv-cinder-84617 Jun 17 13:25:07.000699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-243df4ac-663e-496f-83f3-af396d5517ca req-582531a2-1bcf-4c13-9b4e-dcf798bc42da service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048733 Jun 17 13:25:07.002005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1867/3645] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:07.176579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.185673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8459f492-ef84-4950-b4c9-e7f77e118ac1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1367 microversion: 2.1 time: 0.288367 Jun 17 13:25:07.186829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1779/3646] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:06 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:07.475101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:07.476747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:07.484982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.485655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.486912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.487431 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.537761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:07.538115 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:07.546280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.546736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.547548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.548174 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.674533 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.685573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-415efece-1e42-4eb0-9c1a-8f73594369d9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.215335 Jun 17 13:25:07.686787 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1868/3647] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:07 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:07.691709 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-4340b918-360b-4da0-bacd-e227e2cc7fb4 req-8437ba0c-4ad3-4915-92f9-fc25e47b091d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11", "tag": "0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:07.701453 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4340b918-360b-4da0-bacd-e227e2cc7fb4 req-8437ba0c-4ad3-4915-92f9-fc25e47b091d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.702183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4340b918-360b-4da0-bacd-e227e2cc7fb4 req-8437ba0c-4ad3-4915-92f9-fc25e47b091d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.715938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-4340b918-360b-4da0-bacd-e227e2cc7fb4 req-8437ba0c-4ad3-4915-92f9-fc25e47b091d service nova] Creating event network-changed:0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b for instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 on hv-cinder-84617 Jun 17 13:25:07.721554 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-4340b918-360b-4da0-bacd-e227e2cc7fb4 req-8437ba0c-4ad3-4915-92f9-fc25e47b091d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033251 Jun 17 13:25:07.722200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1869/3648] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:07.735348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:07.736075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:07.738795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.749381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.750120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.750943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.751412 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.752846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.754358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.756830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d28f8ebf-f16b-405d-93fa-a31165698546 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1405 microversion: 2.20 time: 0.224337 Jun 17 13:25:07.757930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1780/3649] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:07 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:07.817008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.825681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-28da713e-aa49-4df5-b68c-0cbde8527c8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.094516 Jun 17 13:25:07.826249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1870/3650] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:07 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:08.202848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:08.203588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:08.210762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.211208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.212010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.212439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.668780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:08.684275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-069405c2-16fd-47b9-b42f-406411c4ae29 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1367 microversion: 2.1 time: 0.485354 Jun 17 13:25:08.692679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1781/3651] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:08 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:08.705873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:08.707774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:08.711835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:08.719959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.720807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.722316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.723009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.774493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:08.775122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:08.789205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.790659 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.796333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.796940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.040759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.049655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.051492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.053473 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4dc714c9-cd25-429f-9f90-a87024ca2c0b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1405 microversion: 2.20 time: 0.282764 Jun 17 13:25:09.054016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1782/3652] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:08 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:25:09.065764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:09.066405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:09.073197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.073639 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.074633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.075261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.182699 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.195570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ff41df60-2c1a-4de7-b035-abceda909636 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.134442 Jun 17 13:25:09.206615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1783/3653] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:09.259398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.267901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cd262cbb-bd67-4fe7-9e8f-5fb8012c90f5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.568550 Jun 17 13:25:09.268473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1871/3654] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:08 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:09.702290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:09.702901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:09.710305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.710755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.711570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.712006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.853801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.866019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-80d9da86-1307-4e20-b857-03c67d0226a9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1367 microversion: 2.1 time: 0.167600 Jun 17 13:25:09.866642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1784/3655] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:09 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:10.071222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:10.071888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:10.078799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.079244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.080040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.080478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.213504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:10.214133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:10.216388 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:10.220649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.221092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.221865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.222303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.226268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:10.227805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:10.228955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-029e998b-999c-4340-a507-a330722ab417 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1405 microversion: 2.20 time: 0.161989 Jun 17 13:25:10.229520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1872/3656] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:10 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:10.286010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:10.289762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:10.290839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:10.296413 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.296828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.297614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.298042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.299178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1a362684-b9db-4f4f-aff1-f6c9412cbdc2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089659 Jun 17 13:25:10.299795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1785/3657] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:10 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:10.437751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:10.446080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ea56d6de-5b83-4dd6-a673-c708631c0ca6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.164161 Jun 17 13:25:10.446692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1873/3658] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:10 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:10.884015 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:10.885005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:10.895046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.895525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.897117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.897578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.920783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:10.973358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-d6a82c58-0caf-4ef1-a372-f9ae021316dc req-d0902bb5-2743-4c74-b879-392b50a2b915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4faf5d-3bec-46ab-8038-57b814a30b3c", "name": "network-vif-plugged", "status": "completed", "tag": "0c85e2cd-3002-4a63-898c-cf35574100c1"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:10.983591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-d6a82c58-0caf-4ef1-a372-f9ae021316dc req-d0902bb5-2743-4c74-b879-392b50a2b915 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.984536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-d6a82c58-0caf-4ef1-a372-f9ae021316dc req-d0902bb5-2743-4c74-b879-392b50a2b915 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.997949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-d6a82c58-0caf-4ef1-a372-f9ae021316dc req-d0902bb5-2743-4c74-b879-392b50a2b915 service nova] Creating event network-vif-plugged:0c85e2cd-3002-4a63-898c-cf35574100c1 for instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c on hv-cinder-84617 Jun 17 13:25:11.003355 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-d6a82c58-0caf-4ef1-a372-f9ae021316dc req-d0902bb5-2743-4c74-b879-392b50a2b915 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105201 Jun 17 13:25:11.004335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1874/3659] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:25:11.046144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.054210 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-41493735-f50c-474f-b031-b71fc7cb45b4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1367 microversion: 2.1 time: 0.174447 Jun 17 13:25:11.054804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1786/3660] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:10 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:11.248004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:11.248694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:11.256484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.256928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.257696 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.258137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.316734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:11.317381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:11.324737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.325429 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.325943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.326350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.389998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.398994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-892f178c-82d9-4f17-8ab6-6aaa65f8c01d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086017 Jun 17 13:25:11.399508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.399700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1787/3661] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:11.407959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.409444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.410576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d65e4736-dc6f-4dbb-ad20-4bb86e7fe459 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1405 microversion: 2.20 time: 0.167382 Jun 17 13:25:11.411104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1875/3662] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:11 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:11.465152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:11.466259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:11.473342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.473769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.474578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.475014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.619191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.627739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0ffab808-b8e7-4d4e-91e5-0d5abc5b9dca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.166854 Jun 17 13:25:11.628348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1788/3663] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:11 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:12.075455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:12.076515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:12.085839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.086278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.087032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.087472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.228244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.236478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a550d638-06e2-49ce-8b41-56a0f9792ffa tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1367 microversion: 2.1 time: 0.167308 Jun 17 13:25:12.237028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1876/3664] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:12 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:12.418539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:12.419592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:12.426906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.427995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.428806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.428999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:12.429465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.429583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:12.436882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.437331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.438096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.438529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.494103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.510526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-754b011c-af3b-4f53-ba74-20c5eaba73d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090121 Jun 17 13:25:12.511172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1789/3665] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:12.590808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.602481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.603981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.605076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2f2dbfb1-ffd2-402d-afeb-6ab81a6536ef tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1405 microversion: 2.20 time: 0.180276 Jun 17 13:25:12.605634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1877/3666] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:12 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:12.645464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:12.646105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:12.653062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.653591 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.654497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.654931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.800912 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.809214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-631708f3-f0ec-462b-8a0d-64e099b13f1b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.167696 Jun 17 13:25:12.809796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1790/3667] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:12 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:13.019588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-a3052995-a970-43c1-81a9-182e45a08101 req-c9dff1c7-5c89-4a7e-99a3-8c1f03a95171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11", "name": "network-vif-plugged", "status": "completed", "tag": "0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:13.028672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-a3052995-a970-43c1-81a9-182e45a08101 req-c9dff1c7-5c89-4a7e-99a3-8c1f03a95171 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.029106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-a3052995-a970-43c1-81a9-182e45a08101 req-c9dff1c7-5c89-4a7e-99a3-8c1f03a95171 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.040251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-a3052995-a970-43c1-81a9-182e45a08101 req-c9dff1c7-5c89-4a7e-99a3-8c1f03a95171 service nova] Creating event network-vif-plugged:0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b for instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 on hv-cinder-84617 Jun 17 13:25:13.045246 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-a3052995-a970-43c1-81a9-182e45a08101 req-c9dff1c7-5c89-4a7e-99a3-8c1f03a95171 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029423 Jun 17 13:25:13.045821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1878/3668] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:13.253619 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.254222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.261326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.261769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.262528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.262936 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.400761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.408787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-88353faa-f781-447e-bb05-8dbfc70dc30c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1557 microversion: 2.1 time: 0.159065 Jun 17 13:25:13.409540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1791/3669] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:13.425693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7e315170-94a6-4f4e-94f8-febf2454d49a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.426263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7e315170-94a6-4f4e-94f8-febf2454d49a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.432944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e315170-94a6-4f4e-94f8-febf2454d49a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.433566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e315170-94a6-4f4e-94f8-febf2454d49a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.434129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e315170-94a6-4f4e-94f8-febf2454d49a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.434555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7e315170-94a6-4f4e-94f8-febf2454d49a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.516928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7e315170-94a6-4f4e-94f8-febf2454d49a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095447 Jun 17 13:25:13.517523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1879/3670] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:13.528231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.528933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.531603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:13.540545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.541246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.542280 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.542718 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.608894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.617817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b9a8e1a8-c2b0-4fe9-8f43-e9bda3ddbdb9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.093537 Jun 17 13:25:13.618579 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1792/3671] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:13.624122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.624774 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.631735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.632183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.632947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.633378 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.826456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.827089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.834252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.834898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.835719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.836152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.871494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.880461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.882127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.883281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef8fdfca-c470-42c7-a921-2494be102a4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1405 microversion: 2.20 time: 0.263095 Jun 17 13:25:13.884258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1880/3672] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:13.988749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.997071 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ede93638-ff1d-4089-a1d8-3392d7b43604 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.174627 Jun 17 13:25:13.997627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1793/3673] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:14.574222 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-71407156-adbd-4970-8aa0-1745d18cd5cf req-22cb43d9-9568-4b25-800d-c3eed7cad7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4faf5d-3bec-46ab-8038-57b814a30b3c", "tag": "0c85e2cd-3002-4a63-898c-cf35574100c1"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:14.577974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:14.578649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=6 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:14.587053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-71407156-adbd-4970-8aa0-1745d18cd5cf req-22cb43d9-9568-4b25-800d-c3eed7cad7d8 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.587505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-71407156-adbd-4970-8aa0-1745d18cd5cf req-22cb43d9-9568-4b25-800d-c3eed7cad7d8 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.600471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-71407156-adbd-4970-8aa0-1745d18cd5cf req-22cb43d9-9568-4b25-800d-c3eed7cad7d8 service nova] Creating event network-changed:0c85e2cd-3002-4a63-898c-cf35574100c1 for instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c on hv-cinder-84617 Jun 17 13:25:14.605524 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-71407156-adbd-4970-8aa0-1745d18cd5cf req-22cb43d9-9568-4b25-800d-c3eed7cad7d8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035234 Jun 17 13:25:14.606264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1881/3674] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:14.634661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:14.635605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:14.637688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=18 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:14.643931 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.644529 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.645425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.646191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.711395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:14.719645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0e6c1cd6-b594-4b66-9729-a4e13d5144f1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089232 Jun 17 13:25:14.720193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1794/3675] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:14.902215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:14.902916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:14.909723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.910176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.911015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.911568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.015290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:15.015953 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:15.024093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.024545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.025395 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.025826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.137560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:15.147287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:15.153307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:15.154961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-23fb237b-67f6-49c7-835c-d6b474622357 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1597 microversion: 2.20 time: 0.257282 Jun 17 13:25:15.168437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1882/3676] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:25:14 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1597 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:25:15.174944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b2a33c27-2e17-4679-b08f-56b8a0b8bc71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:15.175476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b2a33c27-2e17-4679-b08f-56b8a0b8bc71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:15.182867 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b2a33c27-2e17-4679-b08f-56b8a0b8bc71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.183309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b2a33c27-2e17-4679-b08f-56b8a0b8bc71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.184116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b2a33c27-2e17-4679-b08f-56b8a0b8bc71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.184547 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b2a33c27-2e17-4679-b08f-56b8a0b8bc71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.205905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:15.216289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9be93ff5-10fb-4d88-b76f-920e1f090b91 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.205731 Jun 17 13:25:15.217304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1795/3677] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:15 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:15.316843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b2a33c27-2e17-4679-b08f-56b8a0b8bc71 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146744 Jun 17 13:25:15.317659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1883/3678] 10.222.0.87 () {60 vars in 1315 bytes} [Fri Jun 17 13:25:15 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:25:15.739606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:15.741105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:15.748779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.750137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.751154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.751919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.821363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:15.829587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5fc50c19-6227-470c-8abf-94c17cbac969 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.095025 Jun 17 13:25:15.830172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1796/3679] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:16.234583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:16.235188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:16.242727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:16.243171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:16.244063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:16.244495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:16.738946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:16.744627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-58a787a2-5169-420a-8c05-eee7a0db86ad req-bb8ccc6a-4c74-417c-b913-4a7db0ef63f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11", "tag": "0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:25:16.747484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bbf646cf-4fca-40e9-99bc-fd66877fecf5 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.517390 Jun 17 13:25:16.748056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1884/3680] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:16 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:16.757360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-58a787a2-5169-420a-8c05-eee7a0db86ad req-bb8ccc6a-4c74-417c-b913-4a7db0ef63f0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:16.757360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-58a787a2-5169-420a-8c05-eee7a0db86ad req-bb8ccc6a-4c74-417c-b913-4a7db0ef63f0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:16.767602 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-58a787a2-5169-420a-8c05-eee7a0db86ad req-bb8ccc6a-4c74-417c-b913-4a7db0ef63f0 service nova] Creating event network-changed:0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b for instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 on hv-cinder-84617 Jun 17 13:25:16.773366 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-58a787a2-5169-420a-8c05-eee7a0db86ad req-bb8ccc6a-4c74-417c-b913-4a7db0ef63f0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Jun 17 13:25:16.774091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1797/3681] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:25:16.847026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:16.847673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:16.853948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:16.854738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:16.855801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:16.856514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:16.940882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:16.950800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3bed073e-843b-4c2a-90a5-6da8f5c547e7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.107519 Jun 17 13:25:16.951525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1885/3682] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:17.766181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:17.766913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:17.773990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.774453 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.775182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.775679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.931971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:17.940925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2243d4f0-1784-401b-a8d5-9a510bf90360 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.179531 Jun 17 13:25:17.941500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1798/3683] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:17.972761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:17.973747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:17.984598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.985480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.987077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.987761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.992761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:18.064850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:18.076665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76232219-d167-4f4a-9b7f-0f45feeee738 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.110174 Jun 17 13:25:18.077525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1886/3684] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:18.962207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:18.962798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:18.970273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.970740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:18.971633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.972092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.095192 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:19.095900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:19.104104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.104584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.105452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.105927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.115327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:19.124526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8452c5b9-98f3-4839-b5ef-99e2f6f93b95 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.168846 Jun 17 13:25:19.125148 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1799/3685] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:18 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:19.172190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:19.182019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-76d26590-cdc9-4c6d-b88b-c213a42df6fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091201 Jun 17 13:25:19.182617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1887/3686] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:20.142283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:20.142829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:20.150610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.151144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.151999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.152409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.203778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:20.204873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:20.211882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.212503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.213455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.213973 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.279186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:20.288996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-704631a0-7d78-494b-bbab-fdfbbef1dcba tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091426 Jun 17 13:25:20.289572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1888/3687] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:20 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:20.297832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:20.305982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b6d0bd2e-4cd9-45f5-ae9d-a22c4458e5fe tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.167652 Jun 17 13:25:20.306901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1800/3688] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:20 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:21.310141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:21.311043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:21.322271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.322993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.324250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.324886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.326615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:21.327542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:21.334884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.335328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.336112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.336545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.389555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:21.398138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-09861b85-7e8a-4598-b872-2f004489fbb0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.094909 Jun 17 13:25:21.398720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1889/3689] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:21.468372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:21.477809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f76edc7d-9214-4d51-b5ca-09735fd263e0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.157137 Jun 17 13:25:21.478383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1801/3690] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:22.416255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:22.416835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:22.424409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.424859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:22.425620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.426056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:22.492573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:22.495114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:22.495812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:22.501713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7ae83078-b75e-4469-905b-cf398316b249 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089730 Jun 17 13:25:22.502302 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1890/3691] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:22.502831 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.503270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:22.504293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.504730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:22.640256 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:22.649547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-32b2b8d0-2a60-497b-a86b-003fe3d681ef tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158394 Jun 17 13:25:22.650192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1802/3692] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:22 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:23.521184 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:23.521780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:23.529370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.529930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.530770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.531336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.605433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:23.617125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0a17616c-d3a0-4b06-9763-bcac43a77342 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.100714 Jun 17 13:25:23.617951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1891/3693] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:23.667760 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:23.668352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:23.676532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.677004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.677857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.678319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.822020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:23.826283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:23.834974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-495a6a1d-5e0e-4e6a-b609-5b843ed34f10 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.171680 Jun 17 13:25:23.835621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1803/3694] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:23 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:24.639830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:24.640501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:24.648747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.649190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.649957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.650409 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.717274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:24.725912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3d1d79e3-038f-4ce9-ae7d-42609e274563 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090095 Jun 17 13:25:24.726479 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1892/3695] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:24.854901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:24.855567 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:24.864501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.864952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.865730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.866195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.003456 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:25.011839 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e2620d30-f473-4c6c-89b2-d2417b079b2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.161050 Jun 17 13:25:25.012419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1804/3696] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:25.746447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:25.747048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:25.754173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.754613 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.755362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.755814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.825830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:25.835133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2dd6c87e-8cd2-4109-a6b9-82673e89e799 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.092558 Jun 17 13:25:25.835836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1893/3697] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:25 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:26.029836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:26.030518 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:26.038076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.038523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.039285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.039748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.180586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:26.189037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a7753d3a-08ea-4c56-ba9e-f07a522ccda0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.162947 Jun 17 13:25:26.190062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1805/3698] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:26.853482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:26.854093 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:26.861437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.861883 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.862685 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.863118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.928372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:26.936579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2858fcb4-8c92-41c8-9498-f050b623e4ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087109 Jun 17 13:25:26.937150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1894/3699] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:27.207488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:27.208082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:27.215199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.215670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.216440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.216867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.353626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:27.362362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0db89ede-105b-4044-9e9b-c1fbc8831a83 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158926 Jun 17 13:25:27.362925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1806/3700] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:27.954983 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:27.955689 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:27.962626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.963063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.963860 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.964297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.029343 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:28.038410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-744cb92b-fc49-48d0-a315-d5596ed08b6a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087665 Jun 17 13:25:28.038990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1895/3701] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:28.380540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:28.381133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:28.387731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.388179 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.388938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.389376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.536240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:28.546823 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7569ee23-a311-46cd-be79-a8ee75a86c4d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.170789 Jun 17 13:25:28.547648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1807/3702] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:29.056455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:29.057086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:29.064322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:29.064770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:29.065525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:29.065980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:29.137324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:29.146031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0be808ec-cc07-4052-8dcc-a740a21dc912 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.093789 Jun 17 13:25:29.146608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1896/3703] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:29.565914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:29.566668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:29.573480 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:29.573999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:29.574775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:29.575208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:29.726849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:29.736598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a099f077-286e-4de2-b827-96881a8c993c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.174170 Jun 17 13:25:29.737183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1808/3704] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:29 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:30.163928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:30.164570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:30.173864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.174324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.175081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.175507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.246593 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:30.256545 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-99090bde-a092-48a6-9473-cd3203cc9bb6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.096544 Jun 17 13:25:30.257117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1897/3705] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:30 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:30.754838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:30.755622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:30.762676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.763135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.763978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.764417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.910279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:30.918560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fc6fd781-b881-41ef-af5f-88162ba873d4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.168053 Jun 17 13:25:30.919105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1809/3706] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:30 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:31.276541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:31.277141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:31.284048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.284501 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.285274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.285705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.352497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:31.361485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d21513f7-3211-4762-a767-dd69f28728db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.088618 Jun 17 13:25:31.362030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1898/3707] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:31.935958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:31.936604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:31.943774 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.944221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.944991 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.945427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.079039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:32.087964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ac956d83-3c23-4561-b771-0275ff6e1645 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.155918 Jun 17 13:25:32.088536 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1810/3708] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:32.379128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:32.379738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:32.386692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.387144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.387920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.388347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.452480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:32.461249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c507da4-02a3-4fb6-9e15-f877d0a4c3fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086081 Jun 17 13:25:32.461826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1899/3709] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:33.105755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:33.106461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:33.113947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:33.114386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:33.115208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:33.115646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:33.249126 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:33.257289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0c87248a-58e9-4e68-b7a4-3a5228030275 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.155544 Jun 17 13:25:33.257861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1811/3710] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:33 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:33.478653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:33.479241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:33.486268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:33.486715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:33.487514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:33.487946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:33.551656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:33.564471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-79d0bb91-194e-48f6-aed1-cca53403680b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089621 Jun 17 13:25:33.564982 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1900/3711] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:34.274641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:34.275193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:34.277660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=82 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:34.283617 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.284062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.284817 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.285249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.422498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:34.433564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3e3d61fe-90ab-4ace-8ea1-fe2f4875c380 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.162528 Jun 17 13:25:34.434440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1812/3712] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:34 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:34.582164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:34.582844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:34.589832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.590281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.591055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.591594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.655148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:34.664432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-396dff7a-93b0-4a4c-91ae-990a0b078efc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086319 Jun 17 13:25:34.665027 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1901/3713] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:35.452901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:35.453492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:35.461394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.461827 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.462613 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.463042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.611166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:35.622074 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3183f08a-19b8-43af-9747-1eaab12a61b9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.172938 Jun 17 13:25:35.622829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1813/3714] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:35 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:35.685196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:35.686120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:35.694188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.694637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.695405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.695863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.765615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:35.769717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:35.775419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3faeda2a-8fd1-48d8-94ec-6eba202ce01b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.096354 Jun 17 13:25:35.776149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1902/3715] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:36.643261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:36.643951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:36.650528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.650976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.651769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.652197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.788505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:36.793258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:36.793897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:36.796782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-978299f4-5dc9-485b-a94a-0c0f8d6d37c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.157893 Jun 17 13:25:36.797346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1814/3716] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:36 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:36.801936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.802385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.803151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.803618 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.866215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:36.874488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c3dc3f78-314c-4745-b87b-9f2f767e6b5a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.085463 Jun 17 13:25:36.875054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1903/3717] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:37.815947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:37.816590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:37.823759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.824203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.824966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.825372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.892062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:37.893370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:37.899512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.899971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.900738 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.901171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.967625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:37.973678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:37.976398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-45e3cea0-148d-4da4-932a-ccfbfcf732ff tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.088299 Jun 17 13:25:37.977276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1904/3718] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:37.981933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-23005f82-3eac-402a-8ef5-4dce431cd807 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.171426 Jun 17 13:25:37.982495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1815/3719] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:37 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:38.994449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:38.995076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:38.998764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=68 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:39.002162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:39.002940 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:39.003107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:39.003482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:39.004254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:39.004688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:39.009911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:39.010363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:39.011133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:39.011637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:39.068149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:39.076658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8e08521f-d25a-465c-8ca0-7656b922541e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086086 Jun 17 13:25:39.077259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1905/3720] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:39.147493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:39.156001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-37a82f73-b81e-48c6-9e2e-7fb8d0787819 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158060 Jun 17 13:25:39.156546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1816/3721] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:38 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:40.094370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:40.095057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:40.102359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.102805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.103625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.104062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.174033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:40.174323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:40.174941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:40.181722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.182167 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.182948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.183132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9ceefebf-e2f3-41fe-bf8d-957c9a796dfb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.092685 Jun 17 13:25:40.183397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.183699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1906/3722] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:40.326902 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:40.340211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0b2008a7-9994-4b28-815e-b3bd1f8e9467 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.169492 Jun 17 13:25:40.341055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1817/3723] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:40 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:41.200734 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:41.201389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:41.208737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.209174 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.209932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.210353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.274979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:41.284582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8ff0a192-eed7-471d-a5bb-02a348139dbe tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087664 Jun 17 13:25:41.285181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1907/3724] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:41.359034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:41.359666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:41.367727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.368081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.368843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.369242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.508960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:41.518076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fbacad1a-7501-4892-b856-cf28e7027c2b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.162914 Jun 17 13:25:41.518661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1818/3725] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:41 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:42.302725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:42.303386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:42.310813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.311260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.312094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.312537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.380811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:42.389477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a226ec97-a8f6-4e4c-80e3-a81cc25de5b2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091042 Jun 17 13:25:42.390067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1908/3726] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:42.537103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:42.537730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:42.548008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.548008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.548008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.548472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.697271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:42.706592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0bd91850-eae2-455b-a881-83e9e2494e73 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.174905 Jun 17 13:25:42.707185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1819/3727] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:42 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:43.411902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:43.412494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:43.426581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.427007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:43.427797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.428219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:43.498536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:43.507481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4706a504-49b1-476e-8960-3620667eb435 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.100276 Jun 17 13:25:43.508031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1909/3728] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:43 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:43.725509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:43.726152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:43.733767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.734216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:43.734990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.735434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:43.757894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:43.874900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:43.884525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fda2dc80-419d-4635-9376-e2cae2f32353 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.163844 Jun 17 13:25:43.885101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1820/3729] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:43 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:44.525187 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:44.525823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:44.533319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:44.533740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:44.534505 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:44.534937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:44.601897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:44.610371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0dac2b7e-e78d-4802-898a-d8d26c3e75c8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089085 Jun 17 13:25:44.611344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1910/3730] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:44.903270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:44.903909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:44.911055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:44.911538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:44.912295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:44.912723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.049674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:45.058108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-947ef3dd-2a6b-454e-8f4c-abc59b33829c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158898 Jun 17 13:25:45.058685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1821/3731] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:44 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:45.629182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:45.629841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:45.636953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.637407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.638167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.638599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.703107 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:45.711566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f294ecb-c884-45cc-9ad7-4b65255a451a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086347 Jun 17 13:25:45.712141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1911/3732] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:46.076361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:46.077035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:46.084386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.084833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.085598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.086031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.229824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:46.238668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-46cef733-b5a9-4097-b910-ab159a628091 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.166288 Jun 17 13:25:46.239249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1822/3733] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:46 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:46.729726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:46.730442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:46.738087 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.738549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.739312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.739770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.803020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:46.811402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b0bb2498-5417-4d46-b353-efa214f487db tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086046 Jun 17 13:25:46.812129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1912/3734] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:47.257093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:47.257764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:47.264696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.265136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.265894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.266322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.404725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:47.416960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2f468cf0-cd09-44e7-b5d3-207ec77b2528 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.163630 Jun 17 13:25:47.417799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1823/3735] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:47 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:47.829244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:47.829881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:47.837261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.837705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.838458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.838895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.910793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:47.919764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b03dc276-1fe0-406f-8f72-2ffe6dcc32fa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.094488 Jun 17 13:25:47.920334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1913/3736] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:48.437471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:48.438058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:48.445125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.445577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:48.446379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.446810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:48.590942 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:48.600666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f11a08fc-98f3-4184-96a5-beadb8b487dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.167192 Jun 17 13:25:48.601279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1824/3737] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:48 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:48.942008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:48.942918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:48.953963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.954704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:48.956248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.956688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:49.023794 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:49.032061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eef90613-b12e-4350-9e00-93a45190def6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.096386 Jun 17 13:25:49.032628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1914/3738] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:49.618188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:49.618826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:49.625864 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:49.626310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:49.627068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:49.627533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:49.779267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:49.788637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c42722a7-fbb9-4b13-aef8-34505c5c8321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.174268 Jun 17 13:25:49.789257 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1825/3739] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:49 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:50.049844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:50.050486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:50.058181 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.058778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.060014 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.060625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.131699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:50.140564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9a3fa155-a56c-45ef-90ab-16b7e134bed7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.094593 Jun 17 13:25:50.141474 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1915/3740] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:50 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:50.682741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4bda2c29-cfc8-4b4e-ab4d-23f28de4d978 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:50.683343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4bda2c29-cfc8-4b4e-ab4d-23f28de4d978 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:50.690633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bda2c29-cfc8-4b4e-ab4d-23f28de4d978 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.691090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bda2c29-cfc8-4b4e-ab4d-23f28de4d978 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.691879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bda2c29-cfc8-4b4e-ab4d-23f28de4d978 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.692315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4bda2c29-cfc8-4b4e-ab4d-23f28de4d978 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.718939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4bda2c29-cfc8-4b4e-ab4d-23f28de4d978 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c/ips" status: 200 len: 150 microversion: 2.1 time: 0.040001 Jun 17 13:25:50.719547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1826/3741] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:25:50 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:25:50.809911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:50.810790 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:50.819084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.819551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.820313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.820742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.966166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:50.975097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-38a9ec89-6ca7-44f3-b870-03b25063825c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.171684 Jun 17 13:25:50.975715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1916/3742] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:51.165484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:51.166096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:51.172845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.173292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.174064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.174485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.239032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:51.247665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bb40a906-f844-41d7-9c27-a198731fef32 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086079 Jun 17 13:25:51.248245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1827/3743] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:51.993454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:51.994083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:52.000771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.001209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.001979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.002405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.145179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:52.154966 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30d040b9-949a-419a-876f-4bd052686228 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.165983 Jun 17 13:25:52.155783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1917/3744] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:51 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:52.265644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:52.266267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:52.274693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.275295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.278590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.278590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.346690 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:52.355230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1d393a4c-d98a-463b-960c-0ea97a1095f0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.093727 Jun 17 13:25:52.355865 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1828/3745] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:52.739006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8852c998-9a67-4527-9ba9-2819e2ffefb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:52.739467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8852c998-9a67-4527-9ba9-2819e2ffefb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:52.746164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8852c998-9a67-4527-9ba9-2819e2ffefb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.746587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8852c998-9a67-4527-9ba9-2819e2ffefb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.747361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8852c998-9a67-4527-9ba9-2819e2ffefb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.747818 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8852c998-9a67-4527-9ba9-2819e2ffefb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.774606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8852c998-9a67-4527-9ba9-2819e2ffefb9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/ips" status: 200 len: 152 microversion: 2.20 time: 0.041537 Jun 17 13:25:52.775228 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1918/3746] 10.222.0.87 () {60 vars in 1288 bytes} [Fri Jun 17 13:25:52 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:25:53.174798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:53.175475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:53.182295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.182744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:53.183542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.183983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:53.317239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:53.330064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8b98ad23-a6cd-41c4-ad35-7cb115ae0e56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158879 Jun 17 13:25:53.331008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1829/3747] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:53.373638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:53.374224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:53.381177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.381630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:53.382397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.382830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:53.448017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:53.451517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:53.457744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a2a95407-d703-42e2-a5fb-3674e5674f03 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087908 Jun 17 13:25:53.458330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1919/3748] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:54.349963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:54.350897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:54.359553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:54.360025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:54.361162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:54.361616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:54.474535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:54.475160 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:54.482148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:54.482601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:54.483361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:54.483864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:54.498229 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:54.507099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0751ada6-f3ba-456c-b67c-52909fedd5f1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.162750 Jun 17 13:25:54.507743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1830/3749] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:54.548288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:54.557483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8efe50f8-8c71-4917-8172-6d30ec09523c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087192 Jun 17 13:25:54.558053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1920/3750] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:54 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:55.524356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:55.524961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:55.531844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.532285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.533032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.533460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.575407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:55.576038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:55.582808 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.583203 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.584049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.584471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.654359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:55.663276 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-35026a3d-0587-4ca8-9454-5ae907846424 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091690 Jun 17 13:25:55.663908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1921/3751] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:55.673198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:55.682373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b9fe785b-3c12-40be-a8e8-11adb52ac9e7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.161932 Jun 17 13:25:55.682943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1831/3752] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:55 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:56.685464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:56.686510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:56.695806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.696254 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.697018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.697446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.700709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:56.701526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:56.709997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.710438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.711195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.711734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.766348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:56.775248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1bfd9caf-a8a8-4576-ac9a-6c38fa928196 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.096617 Jun 17 13:25:56.775866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1922/3753] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:56 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:56.854095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:56.862714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cdd11ba7-b9d4-4bbb-a344-664770661b60 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.166489 Jun 17 13:25:56.863267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1832/3754] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:57.793182 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:57.793825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:57.801301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.801750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.802510 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.802944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.874119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:57.882682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7036d080-e2a3-43bd-b1ff-559f77849d43 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.093522 Jun 17 13:25:57.882916 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:57.883415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:57.883608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1923/3755] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:57 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:57.890698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.891146 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.891949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.892385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:58.051391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:58.060088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6eb08809-33fc-42c0-94c5-836489cc8f71 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.181197 Jun 17 13:25:58.060663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1833/3756] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:58.902952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:58.903995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:58.914030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:58.914482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:58.915241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:58.915704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:58.980986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:58.991502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d8ce091f-2263-4a25-bf90-90b5787f75f2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.092904 Jun 17 13:25:58.992147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1924/3757] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:58 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:59.081787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:59.082390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:59.093241 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:59.093899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:59.095114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:59.095855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:59.256306 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:59.267923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1e53c588-43eb-4bfa-9913-2755772b0fd3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.192587 Jun 17 13:25:59.268725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1834/3758] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:00.012665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:00.013326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:00.023428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.023904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.024723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.025180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.100079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:00.108373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-968320c3-4954-4c29-8b34-57c68d3e4500 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.100690 Jun 17 13:26:00.108968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1925/3759] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:00 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:00.285499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:00.286041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:00.293031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.293486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.294258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.294693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.437679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:00.446773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2695dc64-2037-4be6-8ec3-d969c360f835 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.165480 Jun 17 13:26:00.447356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1835/3760] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:01.127898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:01.128772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:01.137449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.137900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.138655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.139090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.213980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:01.228581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5f52a5a7-46b5-4643-bba6-518b3b75bb0e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.105404 Jun 17 13:26:01.229265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1926/3761] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:01 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:01.470761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:01.471358 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:01.480144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.480587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.481346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.481777 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.625976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:01.634267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a50752d3-1fd0-49d1-b4e6-2d5f6a59d9b0 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.167620 Jun 17 13:26:01.634874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1836/3762] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:01 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:02.248090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:02.248710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:02.257243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.257697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.258437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.258891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.322070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:02.330475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ca3a696-a317-4b86-850f-32fcb2d09511 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.088026 Jun 17 13:26:02.331063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1927/3763] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:02 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:02.651945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:02.652599 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:02.659672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.660121 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.660878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.661311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.679568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:02.798576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:02.806805 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-37992028-4ad0-4d4e-aff6-2157e3d5ea00 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158801 Jun 17 13:26:02.807708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1837/3764] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:02 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:03.350816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:03.351571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:03.360735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.361218 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.361975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.362404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.427022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:03.436389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0a341346-15b4-4d47-8784-036a691c2bd7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090340 Jun 17 13:26:03.436971 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1928/3765] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:03 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:03.826626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:03.827330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:03.834273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.834747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.835530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.835956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.977381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:03.986554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8739069d-1fa7-4c1b-883c-9a92ab14dd1f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.164835 Jun 17 13:26:03.987133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1838/3766] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:03 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:04.453977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:04.454630 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:04.461598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:04.462001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:04.462785 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:04.463221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:04.538886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:04.547538 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f799e6b-aca1-41e6-a925-2d03b7960794 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.097493 Jun 17 13:26:04.548119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1929/3767] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:04 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:05.004462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:05.005153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:05.007696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=54 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:05.015959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.016455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.017357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.017797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.152543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:05.161530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-36a3ac16-0a74-4be2-9c2f-c51a30633761 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.161205 Jun 17 13:26:05.162124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1839/3768] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:04 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:05.565417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:05.566049 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:05.573384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.574467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.575227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.575716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.640562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:05.653193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0b5390d6-1ebe-4356-84a2-67976111114e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091600 Jun 17 13:26:05.653910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1930/3769] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:05 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:06.180157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:06.181776 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:06.189320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.189752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.190528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.190948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.347577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:06.356947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9ffaaf70-15b5-4562-a89a-cd0a3a777d63 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.180950 Jun 17 13:26:06.357554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1840/3770] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:06 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:06.671043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:06.671713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:06.678977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.679429 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.680227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.680653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.753231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:06.764019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4430c886-8204-46a4-80a3-bd1e3e7d8a3e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.096933 Jun 17 13:26:06.765284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1931/3771] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:06 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:07.374402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:07.374966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:07.382142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.382587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.383338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.383906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.544329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:07.554252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1a2b8ebc-d41e-49e9-a91c-a0df97bc1ceb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.184136 Jun 17 13:26:07.554806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1841/3772] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:07 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:07.784950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:07.785579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:07.794172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.794621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.795398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.795851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.860907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:07.869349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ff2b5599-8710-48f2-a592-9f5be1118672 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090136 Jun 17 13:26:07.869924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1932/3773] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:07 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:08.572593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:08.573226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:08.580620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.581069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.581837 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.582273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.714489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:08.722701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6aa29c2-9fa6-405c-9d91-82ca2d6f4419 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.154061 Jun 17 13:26:08.723272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1842/3774] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:08 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:08.886511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:08.887099 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:08.893878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.894349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.895114 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.895582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.961219 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:08.969783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c5bbe7e7-d0f6-41a0-bd94-1f82abb87fb8 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087356 Jun 17 13:26:08.970368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1933/3775] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:08 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:09.740438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:09.741046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:09.748242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.748680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:09.749450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.749877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:09.886587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:09.895412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b0fa1dbd-167c-48a7-aeb1-3a455adcfffd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158992 Jun 17 13:26:09.896026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1843/3776] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:09 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:09.988352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:09.988990 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:09.991335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=58 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:09.996827 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.997289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:09.998447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.998875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:10.061864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:10.069995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4ddcb24a-3106-4655-baa1-c2a335774dc0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.085919 Jun 17 13:26:10.070560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1934/3777] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:09 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:10.913735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:10.914381 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:10.921818 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:10.922272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:10.923033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:10.923500 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.055696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:11.064464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c3d57a08-e408-4fc3-84ff-77dc8d6a650e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.154662 Jun 17 13:26:11.065032 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1844/3778] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:10 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:11.087730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:11.088348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:11.095759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.096234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.097009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.097440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.166853 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:11.175394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b9b9673-b898-44f7-bb75-06dbf4c7080f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091565 Jun 17 13:26:11.175967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1935/3779] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:11 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:12.083491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:12.084147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:12.091227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.091701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.092455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.092884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.192329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:12.192938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:12.200856 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.201401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.202171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.202606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.221762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:12.229028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:12.237783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1b2e2f50-7a53-479c-8a62-158113b33319 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158231 Jun 17 13:26:12.238957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1845/3780] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:12 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:12.267651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:12.275926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2a931924-3e20-4ef3-b46e-bc602b90f33a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087521 Jun 17 13:26:12.276494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1936/3781] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:12 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:13.255412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:13.256063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:13.263523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.263965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.264740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.265180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.293280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:13.293892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:13.301236 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.301675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.302442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.302877 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.369443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:13.377817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7b2c53cb-ee65-45a1-8e92-bc434a927ec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.088378 Jun 17 13:26:13.383991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1937/3782] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:13 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:13.399323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:13.408315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-72e5d77e-8097-4d32-b5be-433bc8d6aded tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.156857 Jun 17 13:26:13.409089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1846/3783] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:13 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:14.395670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:14.396294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:14.403305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.403836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.404826 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.405269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.426417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:14.427043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:14.434178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.434620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.435412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.435845 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.473048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:14.481944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-22df70b8-f8f2-4161-84bb-c9e2c44804f3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090114 Jun 17 13:26:14.482845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1938/3784] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:14 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:14.581926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:14.590413 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62bdd03e-5d89-409a-b7fb-e39088b33f37 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.167866 Jun 17 13:26:14.591281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1847/3785] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:14 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:15.499772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:15.501208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:15.508578 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.509017 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.509898 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.510337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.578975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:15.589446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4056e245-e44c-42f2-913a-f7216d7eea55 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.093921 Jun 17 13:26:15.590018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1939/3786] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:15 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:15.608018 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:15.608607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:15.616821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.617266 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.618014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.618442 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.780531 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:15.790565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cacac95d-be73-460d-ae9e-3054f395b136 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.186618 Jun 17 13:26:15.791145 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1848/3787] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:15 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:16.607820 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:16.608448 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:16.616256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.616723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:16.617457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.617886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:16.681089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:16.689895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-71ffd239-f084-4247-b344-e84b8ee8c1b0 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.086155 Jun 17 13:26:16.690469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1940/3788] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:16 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:16.809184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:16.809899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:16.816951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.817402 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:16.818164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.818598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:16.947092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:16.955851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a37ac00-37e3-43ef-91e5-23915b32a4db tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.150846 Jun 17 13:26:16.956435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1849/3789] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:16 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:17.707537 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:17.708245 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:17.715743 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.716316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.717209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.717694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.791033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:17.801480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0037af54-9bae-4d7d-a917-ef1a796fca2a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.097919 Jun 17 13:26:17.802231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1941/3790] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:17 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:17.974396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:17.974983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:17.982687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.983184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.984063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.984554 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.128971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:18.142299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4b13bcca-224a-46ec-90f0-c509fa8e4138 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.172398 Jun 17 13:26:18.142948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1850/3791] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:17 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:18.823238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:18.824135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:18.830991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.831586 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.832349 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.832781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.906411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:18.915498 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-66fd7860-1ec1-43e5-ae03-5102529e55a7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.097014 Jun 17 13:26:18.916080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1942/3792] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:18 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:19.164352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:19.164987 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:19.172986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.173425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.174184 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.174719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.330773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:19.340701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-104cc5f3-f20c-4445-86ee-4cb8cb496dda tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.181789 Jun 17 13:26:19.341372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1851/3793] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:19 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:19.933544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:19.934196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:19.941199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.941652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.942411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.942845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.008848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:20.017325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c09934ea-91b0-4d67-b718-c990c70303e5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087818 Jun 17 13:26:20.017888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1943/3794] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:19 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:20.365440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:20.366341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:20.373438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.373883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.374670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.375101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.523680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:20.538313 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-81f6b1a0-dedf-43c3-a39e-837a6a460c56 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.179272 Jun 17 13:26:20.538996 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1852/3795] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:20 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:21.039397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:21.040442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:21.051598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.052338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.053786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.054305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.128550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:21.137033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-05d40516-fb24-4a3a-8139-e5082e0ac1dc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.104123 Jun 17 13:26:21.137599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1944/3796] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:21 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:21.557423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:21.558325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:21.566762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.567389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.568161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.568592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.726732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:21.735232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1aee6c7-0be5-4002-a948-53692888202d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.181464 Jun 17 13:26:21.735821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1853/3797] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:21 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:22.155583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:22.156298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:22.165477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.165926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.166679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.167109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.233951 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:22.245496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2d42c141-fd4f-42e5-b652-0048bc08ee4e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.094115 Jun 17 13:26:22.245655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1945/3798] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:22 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:22.756572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:22.757641 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:22.765326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.765779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.766521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.766947 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.770989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:23.062092 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:23.070930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2cfee550-082d-4a69-ac3c-d8df33203321 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.320333 Jun 17 13:26:23.071543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1854/3799] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:22 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:23.265606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:23.266202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:23.273154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.273602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.274358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.274932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.338815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:23.347401 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9467444d-c735-4149-9544-e606468e4980 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.085751 Jun 17 13:26:23.348004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1946/3800] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:23 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:24.089391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:24.090098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:24.097078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.097631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.098566 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.099003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.248509 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:24.260982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa17da94-c10c-4e7a-a3f0-bc3f9225d89a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.175633 Jun 17 13:26:24.261553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1855/3801] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:24 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:24.368849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:24.370515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:24.380183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.380849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.381991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.382639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.458651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:24.470582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8a5f866a-63b1-47ea-a726-f440ebf82967 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.107839 Jun 17 13:26:24.471306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1947/3802] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:24 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:25.281706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:25.282482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:25.292992 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.293443 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.294194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.294625 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.438950 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:25.452333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-af457552-1651-4b8f-8e98-fb5ea771410e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.176608 Jun 17 13:26:25.453080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1856/3803] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:25 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:25.493198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:25.494307 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:25.501514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.501957 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.502708 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.503133 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.566648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:25.576954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-492db75d-70a9-47a8-ba52-188e56e5c00d tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089918 Jun 17 13:26:25.577511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1948/3804] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:25 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:26.473391 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:26.474664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:26.481795 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.482243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.482965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.483426 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.594445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:26.595082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:26.602073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.602523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.603450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.603914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.618157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:26.627063 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6ccc3964-fec5-4cdd-9590-8a3083675151 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.157601 Jun 17 13:26:26.627789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1857/3805] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:26 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:26.669357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:26.677560 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f58664a4-c58d-4946-9c71-f4dc02e8331c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087117 Jun 17 13:26:26.678144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1949/3806] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:26 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:27.646804 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:27.647488 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:27.655255 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.655775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.656652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.657151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.696046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:27.696751 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:27.704076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.704541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.705310 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.706837 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.770953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:27.779845 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-01763471-fa96-4b0d-8634-4c0f96f6e2ac tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087860 Jun 17 13:26:27.780491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1950/3807] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:27 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:27.792821 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:27.801043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-783d4721-ed15-460e-afc4-d05ad0c02aa6 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.159266 Jun 17 13:26:27.801578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1858/3808] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:27 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:28.797764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:28.798477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:28.809748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.810389 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.811589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.812259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.820523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:28.821232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:28.828541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.828981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.829737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.830165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.881525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:28.890499 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1dd335e1-dae0-4631-82fa-6d02ae7072e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.096601 Jun 17 13:26:28.891108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1951/3809] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:28 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:28.969757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:28.980217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b33ba0f4-4987-4ecf-a03e-6b2aaa13487f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.164956 Jun 17 13:26:28.980968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1859/3810] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:28 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:29.908260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:29.908935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:29.917149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:29.917596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:29.918371 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:29.918805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.002343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:30.003033 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:30.010755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.011198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.012030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.012466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.175909 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:30.187209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dc63fcc8-e5ad-4442-93e0-289af715e90e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.282594 Jun 17 13:26:30.188263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1952/3811] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:29 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:30.192224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:30.201854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-48f7808a-8545-46b5-9689-4ceda8d5ab7d tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.203402 Jun 17 13:26:30.202835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1860/3812] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:29 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:31.209744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:31.210346 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:31.217520 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.217967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.218729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.219158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.223335 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:31.223901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:31.224028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:31.233021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.233496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.234276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.235062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.288008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:31.296550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9599f44f-0d13-4227-86d5-052c4d04aec6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090678 Jun 17 13:26:31.297138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1953/3813] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:31 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:31.382361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:31.391094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34aaba78-c07f-4b0e-99db-fa632b333b5a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.171720 Jun 17 13:26:31.391664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1861/3814] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:31 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:32.314626 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:32.315268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:32.322553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.322997 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.323807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.324239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.389607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:32.398248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5313213d-87a8-400d-bd77-1ea94806155c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087501 Jun 17 13:26:32.398823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1954/3815] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:32 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:32.408547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:32.409154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:32.416120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.416720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.417349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.417850 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.560908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:32.569559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-69a8b732-39a3-4662-a1c9-64554e30883c tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.164857 Jun 17 13:26:32.570158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1862/3816] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:32 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:33.419359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:33.419953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:33.426906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.427363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.428159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.428591 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.493540 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:33.502232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b9ce976d-29c1-4fa7-afcb-e188e8b8a99c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087879 Jun 17 13:26:33.502836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1955/3817] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:33 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:33.586917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:33.587547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:33.595055 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.595522 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.596282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.596709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.737879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:33.746643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-565fde4a-2bdd-4475-8c86-e57b2d40e23b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.163691 Jun 17 13:26:33.747196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1863/3818] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:33 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:34.519863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:34.520491 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:34.527656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.528106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.528879 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.529311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.594472 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:34.603034 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0c8d3c5a-c7bf-4b44-8820-6f385d72642f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087144 Jun 17 13:26:34.603632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1956/3819] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:34 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:34.768383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:34.769346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:34.780762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.781423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.782762 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.783485 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.928128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:34.940854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d387330d-e7d5-4d21-bb87-8e9da08aa400 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.178903 Jun 17 13:26:34.941627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1864/3820] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:34 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:35.626440 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:35.627082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:35.634116 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.634558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.636161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.636601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.704782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:35.713259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-44a5bb6f-304f-42b0-a429-6eaa8ab49340 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090694 Jun 17 13:26:35.714005 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1957/3821] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:35 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:35.961217 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:35.961806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:35.964232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=52 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:35.970103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.970549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.971318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.971781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.107593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:36.116422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-31a7010a-ab57-4bbb-947e-5bf7887bc425 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.159154 Jun 17 13:26:36.116976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1865/3822] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:35 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:36.731320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:36.731940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:36.739042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.739541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.740405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.740849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.808082 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:36.819882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-30f69a3b-11d6-4fd1-a7a9-5a89818f8311 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.092330 Jun 17 13:26:36.820810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1958/3823] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:36 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:37.133724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:37.134345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:37.142288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.142740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.143552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.143990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.279694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:37.288099 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f266c847-bd47-4679-8bf5-0ee690f1a5c9 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.158453 Jun 17 13:26:37.288675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1866/3824] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:37 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:37.846224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:37.847277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:37.857048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.857497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.858269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.858694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.923018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:37.931325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fe973a54-945b-4637-812a-725dc535d866 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091550 Jun 17 13:26:37.932617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1959/3825] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:37 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:38.308130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:38.308758 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:38.316052 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.316511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.317270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.317698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.462926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:38.471503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d8eb6d88-e398-4eea-8e94-aa8bccd19ba1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.168972 Jun 17 13:26:38.472069 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1867/3826] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:38 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:38.954434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:38.955075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:38.962118 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.962566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.963508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.963962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.033406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:39.046422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-11d848ea-5ca1-4b9c-a6c5-612fff27dffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.095630 Jun 17 13:26:39.047360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1960/3827] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:38 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:39.490645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:39.491277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:39.498530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.499319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.499791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.500226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.640042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:39.648325 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d4b904d3-3284-47a2-9239-619e8b8e87f8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.161590 Jun 17 13:26:39.648887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1868/3828] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:39 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:40.068615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:40.069225 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:40.071562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=54 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:40.077759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.078207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.079110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.079563 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.146812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:40.155767 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5998167e-400b-4663-a22f-ce0df474aade tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091021 Jun 17 13:26:40.156333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1961/3829] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:40 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:40.665965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:40.667423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:40.673907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.674362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.675130 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.675624 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.816574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:40.825228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8ca24fa7-bf79-4f03-a08c-ea145030343b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.163136 Jun 17 13:26:40.825809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1869/3830] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:40 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:41.173532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:41.174156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:41.181016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:41.181467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:41.182227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:41.182662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:41.245567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:41.253920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5fbddaf1-0796-40a6-b0c4-751b027c64d3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.084391 Jun 17 13:26:41.254463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1962/3831] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:41 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:41.842475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:41.843123 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:41.850105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:41.850547 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:41.851455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:41.851900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.000648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:42.004318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=100 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:42.010887 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9e57ac63-3444-45f0-8e3b-e11dabf1cb02 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.171649 Jun 17 13:26:42.011497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1870/3832] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:41 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:42.271687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:42.272289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:42.279584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.280019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.280775 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.281200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.344151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:42.353338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e844446e-4e14-48ae-8836-05f969db92a3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.085561 Jun 17 13:26:42.354108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1963/3833] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:42 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:43.028990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:43.029621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:43.036597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.037043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.037806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.038240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.172143 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:43.180628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4b62b747-b65f-47eb-bae3-a1bc694f375a tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.155860 Jun 17 13:26:43.181192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1871/3834] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:43 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:43.371871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:43.372454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:43.379315 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.379799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.380557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.380987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.451305 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:43.459687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fb5f5f6b-6600-4314-94a1-f60a08fff1ca tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.092095 Jun 17 13:26:43.460293 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1964/3835] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:43 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:44.198433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:44.199036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:44.206066 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.206512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.207270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.207737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.341040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:44.349735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dbe668ea-a91b-4739-a15b-402807ad0038 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.155329 Jun 17 13:26:44.350342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1872/3836] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:44 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:44.478106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:44.478742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:44.486121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.486567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.487294 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.487788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.552795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:44.561426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bb0570f5-aea2-4005-9f3c-ba0d4fb6c4d5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.087260 Jun 17 13:26:44.561977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1965/3837] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:44 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:45.368507 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:45.369135 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:45.377104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.377549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.378322 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.378751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.520757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:45.529849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-303c9fc8-39f9-4949-82d1-593dfd78fe36 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.165271 Jun 17 13:26:45.530416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1873/3838] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:45 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:45.578549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:45.579185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:45.586603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.587060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.587885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.588326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.659900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:45.668567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7cd83005-23c5-497c-b487-753434b9ebe5 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.093872 Jun 17 13:26:45.669124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1966/3839] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:45 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:46.547621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:46.548263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:46.555338 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.555816 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.556585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.557027 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.686828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:46.687504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:46.694529 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.694979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.695797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.696229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.698288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:46.706621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e8665949-e184-4890-8a3c-1813a5e0ac23 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.162945 Jun 17 13:26:46.707238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1874/3840] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:46 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:46.764059 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:46.772154 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f25805a9-ce94-4af9-a959-76dffb4765aa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.089774 Jun 17 13:26:46.772725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1967/3841] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:46 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:47.726403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:47.727047 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:47.735545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.736129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.737285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.737900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.790855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:47.792261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:47.799291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.799758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.800517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.800937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.880740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:47.889266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3d856d55-39de-477a-a303-d98c8c90b9d1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.102242 Jun 17 13:26:47.889884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1968/3842] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:47 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:47.907665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:47.917003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-77a017a2-7629-4da1-be57-6ad18fe5f987 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.194383 Jun 17 13:26:47.917605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1875/3843] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:47 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:48.922142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:48.922781 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:48.929807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.930251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.931101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.931594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.936387 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:48.936957 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:48.944538 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.944979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.945752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.946181 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:49.000981 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:49.004502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:49.010143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-eb08f7cf-2e96-4630-b676-2e73f32b83ec tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.091703 Jun 17 13:26:49.011040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1969/3844] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:48 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:49.083745 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:49.092611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4df4d97a-9cda-4df4-9d18-4c5add76915e tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.160075 Jun 17 13:26:49.093183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1876/3845] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:48 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:50.028394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:50.029003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:50.036095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.036542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.037297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.037733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.105198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:50.114196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:50.114196 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:50.115801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d76a36b7-76eb-4196-809e-8e1ea7b94ffc tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1368 microversion: 2.1 time: 0.090819 Jun 17 13:26:50.116333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1970/3846] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:50 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:50.119114 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.120298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.121128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.121525 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.259444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:50.269667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-adbac595-fff6-4864-96f2-8f52bcba0cdd tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.162555 Jun 17 13:26:50.270578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1877/3847] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:50 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:50.795779 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:50.796067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:50.815054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.815567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.816347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.816772 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.854394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:26:50.955850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-75a10f32-b2d3-48e3-8e90-6b5d43f1be24 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 204 len: 0 microversion: 2.1 time: 0.163691 Jun 17 13:26:50.956438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1971/3848] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:26:50 2022] DELETE /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:26:50.965560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:50.966186 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:50.972705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.973151 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.973915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.974346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.134546 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:51.135901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:51.149873 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:51.151949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.153494 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:51.154539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.163278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.174838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-14acf6b5-ddd0-4680-834c-a2d4569f42ea tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1682 microversion: 2.1 time: 0.213758 Jun 17 13:26:51.175450 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1878/3849] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:50 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:51.230500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:51.231111 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.231828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lazy-loading 'fault' on Instance uuid 57e80959-0f5b-4f32-934a-f939416afe0a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:26:51.286100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:51.286708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:51.291103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.293927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:51.294372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.295272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:51.295730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.304906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2c01fcfa-3046-4e4d-b7d8-1f932b4f29e3 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1462 microversion: 2.1 time: 0.175575 Jun 17 13:26:51.306639 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1972/3850] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:51 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1462 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:51.460019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.469763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d9311912-596b-49d6-8263-fa1f43874331 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.187554 Jun 17 13:26:51.470340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1879/3851] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:51 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:52.193132 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:52.193763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:52.201241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.201660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.202428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.202849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.325979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:52.326674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:52.333888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.334483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.335576 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.336111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.347159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.360908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-05d6d601-e6a3-4c26-9174-50174b518f91 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1682 microversion: 2.1 time: 0.168404 Jun 17 13:26:52.361687 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1973/3852] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:52 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:52.381042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.381472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.381941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lazy-loading 'fault' on Instance uuid 57e80959-0f5b-4f32-934a-f939416afe0a {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:26:52.426023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.435290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-99b06e6a-8c2f-4745-a57e-ff96a742b598 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1462 microversion: 2.1 time: 0.115222 Jun 17 13:26:52.435951 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1880/3853] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:52 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1462 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:52.488587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:52.489281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:52.495650 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.496170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.496996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.497515 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.635423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.643911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fd8947eb-72b9-43b4-bec9-52fefed768c8 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.159570 Jun 17 13:26:52.644481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1974/3854] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:52 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:53.377532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:26:53.378120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.378952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:53.379600 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.384655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.385125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.385898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.386330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.386995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.387460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.388212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.388638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.413375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lazy-loading 'flavor' on Instance uuid 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:26:53.531619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.539813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b178864b-ed37-4624-b755-464fc74e6817 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1682 microversion: 2.1 time: 0.164632 Jun 17 13:26:53.540344 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1975/3855] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:53 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:53.545348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:53.546083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.552235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.552686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.553462 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.553880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.586891 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.587433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.587887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lazy-loading 'fault' on Instance uuid 57e80959-0f5b-4f32-934a-f939416afe0a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:26:53.635303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.650386 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0dd21872-fba6-4bc3-83df-391a5aa4442c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1462 microversion: 2.1 time: 0.108317 Jun 17 13:26:53.660206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1976/3856] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:53 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:53.661483 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:53.662141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.670321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.670858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.671940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.672532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.687858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9bfe1e01-cb40-44f1-a2db-f5e01707310c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/action" status: 202 len: 0 microversion: 2.20 time: 0.314184 Jun 17 13:26:53.688503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1881/3857] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Jun 17 13:26:53 2022] POST /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 13:26:53.697389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:53.698076 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.704801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.705248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.706010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.706438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.809425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.818283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d82c5a8c-9e90-42eb-ba35-84b83f67c418 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.160715 Jun 17 13:26:53.818864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1977/3858] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:53 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:53.840627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.849119 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.850628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.851841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c59b41f5-1b4e-47e9-aa80-79f1b161f3b1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.158746 Jun 17 13:26:53.852392 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1882/3859] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:53 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:54.559789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:54.560451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:54.568109 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.568552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.569835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.569835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.676782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:54.679796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:54.687206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.688197 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.689185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.689792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.712291 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.721858 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-337f50df-d8c4-4d63-b6c3-f1f95d46fbc9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1682 microversion: 2.1 time: 0.167311 Jun 17 13:26:54.728207 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.728694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.729090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lazy-loading 'fault' on Instance uuid 57e80959-0f5b-4f32-934a-f939416afe0a {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:26:54.732521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1978/3860] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:54 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:54.738139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1519217233", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "networks": [{"uuid": "c4173794-86f6-4cbd-99d1-f706c968915d"}]}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:26:54.775740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.784014 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fa9fca75-4532-403c-a7d9-7f0db8e7c8d4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 200 len: 1462 microversion: 2.1 time: 0.115732 Jun 17 13:26:54.784595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1883/3861] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:54 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 1462 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:54.804266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] validate_networks() for [('c4173794-86f6-4cbd-99d1-f706c968915d', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:26:54.836102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:54.836743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:54.843350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.843822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.844731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.845172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.987460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.991478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:54.997393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a34697fd-12b6-423e-b7fc-d625cdaa24dc tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1736 microversion: 2.1 time: 0.165368 Jun 17 13:26:54.997979 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1884/3862] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:54 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:55.003498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.004100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:55.012803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.013688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.014930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.015656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.293873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.317646 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.320585 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.324108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-619402b1-7e0a-433a-8039-9c0f77df9338 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.325094 Jun 17 13:26:55.328022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1885/3863] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:54 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:55.395363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:26:55.395903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:26:55.396461 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:26:55.396934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:26:55.398250 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:26:55.410924 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.411512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.412374 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.413180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.432098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Getting quotas for project 91f9f62d475d4663ae7c211c8adb78e8. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:26:55.438584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Getting quotas for user 31af58bc06a14e3ba8b709b7deb75341 and project 91f9f62d475d4663ae7c211c8adb78e8. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:26:55.450408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:26:55.453476 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:26:55.515303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7590128b-b3cc-4f55-9d35-3b4f7d6a78d0 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781322 Jun 17 13:26:55.523567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1979/3864] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 13:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:26:55.527928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-3f3ffad6-6411-4d3f-b988-a4385319f225 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.528729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-3f3ffad6-6411-4d3f-b988-a4385319f225 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:55.617342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-3f3ffad6-6411-4d3f-b988-a4385319f225 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.626189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-3f3ffad6-6411-4d3f-b988-a4385319f225 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1219 microversion: 2.1 time: 0.102746 Jun 17 13:26:55.627171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1886/3865] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:55 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:55.713033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-b0f5da75-a750-4b96-860c-3453290844e7 req-4d92f6c4-21ed-4ebe-9dc0-1dc643b6c320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a700d72f-235d-44b5-a1e5-45ba058ebc43", "name": "network-vif-deleted", "tag": "f093a78f-c9f5-4342-92b8-5929a8d231a7"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:26:55.722061 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-b0f5da75-a750-4b96-860c-3453290844e7 req-4d92f6c4-21ed-4ebe-9dc0-1dc643b6c320 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.722655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-b0f5da75-a750-4b96-860c-3453290844e7 req-4d92f6c4-21ed-4ebe-9dc0-1dc643b6c320 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.735699 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-b0f5da75-a750-4b96-860c-3453290844e7 req-4d92f6c4-21ed-4ebe-9dc0-1dc643b6c320 service nova] Creating event network-vif-deleted:f093a78f-c9f5-4342-92b8-5929a8d231a7 for instance a700d72f-235d-44b5-a1e5-45ba058ebc43 on hv-cinder-84617 Jun 17 13:26:55.741670 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-b0f5da75-a750-4b96-860c-3453290844e7 req-4d92f6c4-21ed-4ebe-9dc0-1dc643b6c320 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Jun 17 13:26:55.745000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.746428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1980/3866] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:26:55.747249 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:55.762285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.763342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.765331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.765888 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.802801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.803615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:55.814681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.815508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.816607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.817260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.839596 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] HTTP exception thrown: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Request method failure captured: Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a HTTP/1.1 Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjlH4qw7eZHdMiPVaIeNbWwEME0d5X7w0zJ2BIAPVTHOm4uBpKYteGHJQgCMXBhuDNNDBn3yFqubMXH7Y9D0HHg_nm9DJiTriCt-Q0gI3MYrZSxVl91N23DkagPjfMUCJ8DpVW5qxuKPcQJX5iqp4ajiR9YzU_866TsArhC_Mv3nmQ Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:26:55.843564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ead9b99d062e49a88a88e8b37a3b3519", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: f3bfb04b34ed4761bb09be7b29d1ec8f Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:26:55.845297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '57e80959-0f5b-4f32-934a-f939416afe0a'} Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:26:55.846301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:26:55.848643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:26:55.850927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Returning 404 to user: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:26:55.850927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be50a37a-7d0f-4a0c-a689-f59d2389307c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 404 len: 111 microversion: 2.1 time: 0.046721 Jun 17 13:26:55.850927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1981/3867] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:55 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:26:55.867923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c9ed1e7a-16d3-488e-bade-07a7ae921a25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '.version_select at 0x7f454ea29160>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.894146 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c9ed1e7a-16d3-488e-bade-07a7ae921a25 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238307170" status: 202 len: 0 microversion: 2.1 time: 0.043743 Jun 17 13:26:55.894747 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1982/3868] 10.222.0.87 () {58 vars in 1217 bytes} [Fri Jun 17 13:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238307170 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 13:26:56.016885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:56.017312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:56.030439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.030935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.033392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.033875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.358423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.374603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-96264430-b270-49dd-b600-f3efce9f7ad8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1682 microversion: 2.1 time: 0.638191 Jun 17 13:26:56.376985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1887/3869] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:55 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1682 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:56.386357 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:56.388386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:56.396682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.399731 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.401259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.402815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.558403 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.566681 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.568234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.569411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd4e30e8-3a58-4df5-8d9a-a092c70dd53e tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.189061 Jun 17 13:26:56.569980 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1888/3870] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:56 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:56.643939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:56.644705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:56.651990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.652503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.653292 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.654423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.669839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.683678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6cdd071e-0312-414a-a064-2820d908d5f4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1690 microversion: 2.1 time: 0.671219 Jun 17 13:26:56.685417 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1983/3871] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:56 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1690 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:56.810204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.829552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0f43b600-1889-4edc-b824-9abc0ee84fa1 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1271 microversion: 2.1 time: 0.189727 Jun 17 13:26:56.841089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1889/3872] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:56 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:56.846369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-2c566c54-8395-4ec8-985b-3740a9394d7d req-395f2420-364d-482f-961d-766c2eff6460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4faf5d-3bec-46ab-8038-57b814a30b3c", "name": "network-vif-deleted", "tag": "0c85e2cd-3002-4a63-898c-cf35574100c1"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:26:56.855215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-2c566c54-8395-4ec8-985b-3740a9394d7d req-395f2420-364d-482f-961d-766c2eff6460 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.855686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-2c566c54-8395-4ec8-985b-3740a9394d7d req-395f2420-364d-482f-961d-766c2eff6460 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.880216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-2c566c54-8395-4ec8-985b-3740a9394d7d req-395f2420-364d-482f-961d-766c2eff6460 service nova] Creating event network-vif-deleted:0c85e2cd-3002-4a63-898c-cf35574100c1 for instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c on hv-cinder-84617 Jun 17 13:26:56.887272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-2c566c54-8395-4ec8-985b-3740a9394d7d req-395f2420-364d-482f-961d-766c2eff6460 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045143 Jun 17 13:26:56.888178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1984/3873] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:26:57.411708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:57.415254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:57.448630 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.452648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.456647 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.457517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.522809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.523633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.524341 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lazy-loading 'fault' on Instance uuid 4d4faf5d-3bec-46ab-8038-57b814a30b3c {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:26:57.542364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0543b313-05e1-45a7-a422-15f57126a704 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'create', calling method: .version_select at 0x7f45530b8430>, body: {"keypair": {"name": "tempest-keypair-262805253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL35MMud37YKA4sj3iJtpmY4K5kWcjeMiqB9FV8f3ScGsw7zscGFhV4ia7UeXsfo2kY18p5vx2ldbbR0J1DgWQfbMmLp5iZ5mDB7dvXl+WNYnOqGb+I7ZpeJLetvN8NvWw=="}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:26:57.562892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-0543b313-05e1-45a7-a422-15f57126a704 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:26:57.571226 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-0543b313-05e1-45a7-a422-15f57126a704 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for user f3bfb04b34ed4761bb09be7b29d1ec8f and project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:26:57.609623 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0543b313-05e1-45a7-a422-15f57126a704 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077265 Jun 17 13:26:57.611043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1985/3874] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 13:26:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:26:57.617336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:57.618484 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:57.625903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.636009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2763eb89-01b9-40b4-b4b3-2bf2712ae592 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 200 len: 1332 microversion: 2.1 time: 0.245456 Jun 17 13:26:57.638638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.640136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1890/3875] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:57 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:57.640286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.641170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.641723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.705714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:57.706793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:57.720152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.720976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.722385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.724307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.910403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.919155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.922874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.924394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-4fcf9cac-aa42-4c66-8f0b-68c5d2f4b6ad tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.311347 Jun 17 13:26:57.924967 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1986/3876] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:57 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:57.937303 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:57.937922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:57.963180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.965301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.966287 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.967253 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.969464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.983444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-43142244-da2b-419b-a4dd-5268b62e0118 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1690 microversion: 2.1 time: 0.282655 Jun 17 13:26:57.993479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1891/3877] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:57 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1690 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:58.141004 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:58.149679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fafacf93-d356-4cb6-a4fe-aea688a1cb22 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1289 microversion: 2.1 time: 0.220973 Jun 17 13:26:58.155950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1987/3878] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:57 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1289 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:58.661560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:58.661560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:58.670963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.673658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.675411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.678631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.695562 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c HTTP/1.1 Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:26:58.697832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:26:58.699407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '4d4faf5d-3bec-46ab-8038-57b814a30b3c'} Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:26:58.700289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:26:58.701670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:26:58.705232 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:26:58.706368 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-80f722d0-2cf4-4c85-b8f0-7235be59c6c1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 404 len: 111 microversion: 2.1 time: 0.050328 Jun 17 13:26:58.707348 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1892/3879] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:58 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:26:58.716064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-460cc6cf-c32e-45a7-9e57-568c869b46a0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '.version_select at 0x7f45530bd9d0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:58.738350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-460cc6cf-c32e-45a7-9e57-568c869b46a0 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733023356" status: 202 len: 0 microversion: 2.1 time: 0.026284 Jun 17 13:26:58.739700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1988/3880] 10.222.0.87 () {58 vars in 1220 bytes} [Fri Jun 17 13:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733023356 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:26:58.943202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:58.943849 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:58.951422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.952000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.953462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.953899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.015849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:59.017048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:59.024466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.025887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.027522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.028148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.268038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.284404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:59.295602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ebc63dd-4637-4fe8-b706-e13eb1d65dee tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 200 len: 1622 microversion: 2.1 time: 0.284429 Jun 17 13:26:59.311572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1989/3881] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:59 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 1622 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:59.322423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.331331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.332879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.337916 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:59.338920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:59.341459 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-95de68cf-3dc9-4139-aca3-52b25036fdd2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.401979 Jun 17 13:26:59.342281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1893/3882] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:58 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:59.359874 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-0273ffe3-c5f5-4746-be30-5a2b86e11c6e req-347e8ba7-5665-4c3e-9ac3-ce7b729436b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067c508e-8040-41dd-bc09-07434f2ed0af", "name": "network-vif-deleted", "tag": "41f3efe8-155a-46f5-a608-19b404642164"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:26:59.361847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.364230 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.365359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.369555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.388157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0273ffe3-c5f5-4746-be30-5a2b86e11c6e req-347e8ba7-5665-4c3e-9ac3-ce7b729436b0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.389075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0273ffe3-c5f5-4746-be30-5a2b86e11c6e req-347e8ba7-5665-4c3e-9ac3-ce7b729436b0 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.427005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-0273ffe3-c5f5-4746-be30-5a2b86e11c6e req-347e8ba7-5665-4c3e-9ac3-ce7b729436b0 service nova] Creating event network-vif-deleted:41f3efe8-155a-46f5-a608-19b404642164 for instance 067c508e-8040-41dd-bc09-07434f2ed0af on hv-cinder-84617 Jun 17 13:26:59.446703 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-0273ffe3-c5f5-4746-be30-5a2b86e11c6e req-347e8ba7-5665-4c3e-9ac3-ce7b729436b0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099301 Jun 17 13:26:59.448101 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1894/3883] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:26:59.817495 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.827857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c6bbae4b-0679-4964-9626-6f79781a7fbc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.514269 Jun 17 13:26:59.828977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1990/3884] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:59 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:00.314597 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:00.315439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: cf52b0f3-44a6-4d5c-82fb-e662f185c898] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:00.324331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.326383 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.328236 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.328730 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.346006 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 could not be found. Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 HTTP/1.1 Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:27:00.348060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 could not be found. Jun 17 13:27:00.349998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'cf52b0f3-44a6-4d5c-82fb-e662f185c898'} Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 could not be found. Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:00.351094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 could not be found. Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 could not be found. Jun 17 13:27:00.352793 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:00.354943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 404 to user: Instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:00.354943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2206f8e8-7e20-4c7b-beea-a42f3be6c3d2 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898" status: 404 len: 111 microversion: 2.1 time: 0.042505 Jun 17 13:27:00.361009 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:00.361940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:00.370487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1895/3885] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:00 2022] GET /compute/v2.1/servers/cf52b0f3-44a6-4d5c-82fb-e662f185c898 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:27:00.375030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.378678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-65d6b3dd-bc29-474b-98ba-e766a3971f4b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '.version_select at 0x7f4553184040>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:00.379385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.380395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.381325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.415981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-65d6b3dd-bc29-474b-98ba-e766a3971f4b tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986221162" status: 202 len: 0 microversion: 2.1 time: 0.041355 Jun 17 13:27:00.418635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1896/3886] 10.222.0.87 () {58 vars in 1220 bytes} [Fri Jun 17 13:27:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986221162 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:27:00.584409 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-d891ec78-2347-41c0-98f1-f96a010f28b3 req-e2fa5342-a077-454f-a46b-7e678b9fbf2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9414346c-91eb-4032-994f-dc957a77a32a", "tag": "66e8722c-f8e1-48e8-afde-595e57fc5fbd"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:00.597836 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-d891ec78-2347-41c0-98f1-f96a010f28b3 req-e2fa5342-a077-454f-a46b-7e678b9fbf2d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.598664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-d891ec78-2347-41c0-98f1-f96a010f28b3 req-e2fa5342-a077-454f-a46b-7e678b9fbf2d service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.627670 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-d891ec78-2347-41c0-98f1-f96a010f28b3 req-e2fa5342-a077-454f-a46b-7e678b9fbf2d service nova] Creating event network-changed:66e8722c-f8e1-48e8-afde-595e57fc5fbd for instance 9414346c-91eb-4032-994f-dc957a77a32a on hv-cinder-84617 Jun 17 13:27:00.633400 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-d891ec78-2347-41c0-98f1-f96a010f28b3 req-e2fa5342-a077-454f-a46b-7e678b9fbf2d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054278 Jun 17 13:27:00.634349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1897/3887] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:27:00.640913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ee933f73-1af4-472d-8cc2-c89e45a40bc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: .version_select at 0x7f454e91fc10>, body: {"keypair": {"name": "tempest-keypair-594288377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7Vgxn6WhK71FtMW8gDHwSFma33FI0YVxckHTHx7VCZfgDUuu2E84gY044dJRFgB9VgnxqKRxXGgXRZHlhgflS0k5ApOhingeS+LpAyyH8XD4cJiyWu3+3EVdFYx3vexg=="}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:00.660966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-ee933f73-1af4-472d-8cc2-c89e45a40bc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:27:00.666153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-ee933f73-1af4-472d-8cc2-c89e45a40bc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'key_pairs'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:27:00.743590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ee933f73-1af4-472d-8cc2-c89e45a40bc4 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107035 Jun 17 13:27:00.746276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1898/3888] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 13:27:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:00.747682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:00.757641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:00.760143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:00.761588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-cdbd144b-d17d-466c-aeb0-4726ecdd9119 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.405351 Jun 17 13:27:00.762678 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1991/3889] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:00 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:00.849743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:00.850800 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:00.875578 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.877783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.878855 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.879356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:01.183260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.214854 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-41735b04-ffcf-4bfe-9d73-7d3be47c65dd tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.373118 Jun 17 13:27:01.215872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1899/3890] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:00 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:01.483459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-b08d7bf1-ef3e-44d6-b80c-d8245ffcc4a8 req-f33449a7-9d6f-49b6-a555-6657afba3752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf52b0f3-44a6-4d5c-82fb-e662f185c898", "name": "network-vif-deleted", "tag": "0aab43a3-bc7b-4476-a4ce-489abc0ff452"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:01.492106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:01.509035 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-b08d7bf1-ef3e-44d6-b80c-d8245ffcc4a8 req-f33449a7-9d6f-49b6-a555-6657afba3752 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:01.510162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-b08d7bf1-ef3e-44d6-b80c-d8245ffcc4a8 req-f33449a7-9d6f-49b6-a555-6657afba3752 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:01.533414 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-b08d7bf1-ef3e-44d6-b80c-d8245ffcc4a8 req-f33449a7-9d6f-49b6-a555-6657afba3752 service nova] Creating event network-vif-deleted:0aab43a3-bc7b-4476-a4ce-489abc0ff452 for instance cf52b0f3-44a6-4d5c-82fb-e662f185c898 on hv-cinder-84617 Jun 17 13:27:01.539013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-b08d7bf1-ef3e-44d6-b80c-d8245ffcc4a8 req-f33449a7-9d6f-49b6-a555-6657afba3752 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060373 Jun 17 13:27:01.540342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1992/3891] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:01.655883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-468578856", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64b59cbb-49d9-45bc-827b-795881902e72"}], "security_groups": [{"name": "tempest-securitygroup--1110802494"}], "key_name": "tempest-keypair-262805253", "user_data": "}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:01.781248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:01.782000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:01.788628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:01.789695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:01.789903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:01.790340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:01.804189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] validate_networks() for [('64b59cbb-49d9-45bc-827b-795881902e72', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:27:01.949532 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.959403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.961077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.962434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bee9c0cb-97b4-46a3-ac79-5acaa108d735 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.186002 Jun 17 13:27:01.963224 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1993/3892] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:01 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:02.234717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:02.235238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:02.241531 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.241970 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.242731 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.244572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.387884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:02.396759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8b72923c-73c1-4f86-bc4a-daf635841450 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.167120 Jun 17 13:27:02.397340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1994/3893] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:02 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:02.834919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:27:02.835903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:27:02.835903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:27:02.836505 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:27:02.837044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:27:02.851182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.852122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.854276 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.854744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.875214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:27:02.880287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Getting quotas for user f3bfb04b34ed4761bb09be7b29d1ec8f and project ead9b99d062e49a88a88e8b37a3b3519. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:27:02.882686 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:02.894259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:27:02.896895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:27:02.948693 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-439c11a3-4a38-43bd-821d-2a40227035ad tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.301247 Jun 17 13:27:02.953188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1900/3894] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 13:27:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:27:02.964179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6ab17e81-c2af-413f-afa2-fd66ec767516 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:02.965081 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6ab17e81-c2af-413f-afa2-fd66ec767516 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:03.009012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:03.010043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:03.020141 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.020798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.022215 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.022892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.081238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6ab17e81-c2af-413f-afa2-fd66ec767516 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.091552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6ab17e81-c2af-413f-afa2-fd66ec767516 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1236 microversion: 2.1 time: 0.129833 Jun 17 13:27:03.092227 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1995/3895] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:02 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1236 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:03.244396 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.254577 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.256493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.260401 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-97f4ba99-2c4c-4a36-95dd-31458ae31e5f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.280682 Jun 17 13:27:03.263809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1901/3896] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:02 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:03.407199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-637695328", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63451fcb-248d-4063-92cc-62a9c2c4e98f"}], "security_groups": [{"name": "tempest-securitygroup--1749898999"}], "key_name": "tempest-keypair-594288377", "user_data": "}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:03.413893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:03.414697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:03.421048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.421574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.422397 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.422891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.521900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] validate_networks() for [('63451fcb-248d-4063-92cc-62a9c2c4e98f', None, None, None, None, None)] {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:27:03.571124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.580461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-207fb059-d6eb-4f5a-88e7-5e22eda464d4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.170398 Jun 17 13:27:03.580966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1902/3897] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:03 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:03.891653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:03.892347 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:03.899060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.899923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.901309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.901767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.923668 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:27:03.924199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:27:03.924776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:27:03.925272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:27:03.925770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:27:03.936523 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.937117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.937994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.938517 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.945787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:27:03.959555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:27:03.964831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Getting quotas for user 9863e406790b413faf022554ba4b8dfe and project ea1bbb589db14084aff24be5d6e118a3. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:27:03.979930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:27:03.983037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:27:04.046609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3ae20719-d839-4423-bbe4-23a05a7eef82 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.644103 Jun 17 13:27:04.047582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1996/3898] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 13:27:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 13:27:04.071948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1a8c952-8064-4ed1-ad76-6f1f62b0bed3 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 204 len: 0 microversion: 2.1 time: 0.183962 Jun 17 13:27:04.072607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b7298fea-6bfc-448a-9dcc-c85c6350b654 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.073157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1903/3899] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:27:03 2022] DELETE /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:27:04.073610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b7298fea-6bfc-448a-9dcc-c85c6350b654 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.085310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.086252 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.093558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.094297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.095484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.096094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.144470 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b7298fea-6bfc-448a-9dcc-c85c6350b654 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.155504 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b7298fea-6bfc-448a-9dcc-c85c6350b654 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1240 microversion: 2.1 time: 0.090715 Jun 17 13:27:04.156100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1997/3900] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:04.161958 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.162723 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.170561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.171022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.171795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.172795 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.281959 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.293717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-72c93573-d10a-4c0a-b537-993f2ea80a91 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1306 microversion: 2.1 time: 0.135122 Jun 17 13:27:04.300255 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1998/3901] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1306 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:04.300714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.313257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.315120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.317945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f51d393b-92b2-470e-af0b-49801515e765 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1506 microversion: 2.1 time: 0.240024 Jun 17 13:27:04.324110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.324634 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.325178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1904/3902] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:04.325457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.326066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.539881 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.548789 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.550620 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.552015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f9d039bf-2168-4c66-bf04-3018dddfdef5 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.248305 Jun 17 13:27:04.552742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 1999/3903] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:04.604910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.605857 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.612787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.613320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.614105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.614530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.857515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.861735 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:04.867982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9146628a-e559-4478-a7cb-348b6e1bc4e6 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.267095 Jun 17 13:27:04.890976 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1905/3904] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:05.173275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.173938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.190028 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.190573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.191423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.191923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.311700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.312511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.328893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.329559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.331025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.332626 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.471720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.491231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6d8cf61f-5d22-41ac-9e46-fc1ada147894 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1300 microversion: 2.1 time: 0.322119 Jun 17 13:27:05.503693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2000/3905] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1300 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:05.510815 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.511645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.519387 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.519999 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.520976 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.521490 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.559509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.560358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.561074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'fault' on Instance uuid 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:05.642448 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.658080 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.680288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bceed310-9b16-404f-a23a-3114bb727f22 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.372161 Jun 17 13:27:05.681537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1906/3906] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:05.682556 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2d5cba2d-081b-4e25-bf82-254af90ced38 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 200 len: 1311 microversion: 2.1 time: 0.176876 Jun 17 13:27:05.686379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2001/3907] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:05.700487 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.701721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.703702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-94f0c896-1d80-4afa-9993-75fa85939d57 req-ca05f7c1-375f-4e52-93e7-d9f42fd97fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c79dff5-fa8d-4a6c-9097-833e4b9bfc70", "name": "network-vif-deleted", "tag": "1ff34f55-6087-4fc6-8b79-f24499ec625a"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:05.721104 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.722115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.725893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.730783 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.746970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-94f0c896-1d80-4afa-9993-75fa85939d57 req-ca05f7c1-375f-4e52-93e7-d9f42fd97fa3 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.748044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-94f0c896-1d80-4afa-9993-75fa85939d57 req-ca05f7c1-375f-4e52-93e7-d9f42fd97fa3 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.773158 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-94f0c896-1d80-4afa-9993-75fa85939d57 req-ca05f7c1-375f-4e52-93e7-d9f42fd97fa3 service nova] Creating event network-vif-deleted:1ff34f55-6087-4fc6-8b79-f24499ec625a for instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 on hv-cinder-84617 Jun 17 13:27:05.796614 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-94f0c896-1d80-4afa-9993-75fa85939d57 req-ca05f7c1-375f-4e52-93e7-d9f42fd97fa3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105185 Jun 17 13:27:05.799097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1907/3908] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:05.891017 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.892001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.899842 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.901782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.902876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.903810 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.031201 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.044283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.051941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.060309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-f37a05c6-2bb8-4cf2-8d56-ac55e9f117ee tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1743 microversion: 2.20 time: 0.374637 Jun 17 13:27:06.060918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2002/3909] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1743 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:06.197361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.206035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-63f8950d-dafb-497b-a353-d7417fcc3544 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.322019 Jun 17 13:27:06.217503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1908/3910] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:06.309180 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-88e09adb-7417-4677-ba36-b9c60496cac2 req-39ceea24-af2d-40ab-a3ee-3e4cf98ec4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea25a26b-5528-4263-b959-666f40e187ac", "tag": "f3a69d0d-98d4-490c-acb7-38f8368c1bd0"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:06.319422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-88e09adb-7417-4677-ba36-b9c60496cac2 req-39ceea24-af2d-40ab-a3ee-3e4cf98ec4dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.320360 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-88e09adb-7417-4677-ba36-b9c60496cac2 req-39ceea24-af2d-40ab-a3ee-3e4cf98ec4dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.347458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-88e09adb-7417-4677-ba36-b9c60496cac2 req-39ceea24-af2d-40ab-a3ee-3e4cf98ec4dc service nova] Creating event network-changed:f3a69d0d-98d4-490c-acb7-38f8368c1bd0 for instance ea25a26b-5528-4263-b959-666f40e187ac on hv-cinder-84617 Jun 17 13:27:06.358423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-88e09adb-7417-4677-ba36-b9c60496cac2 req-39ceea24-af2d-40ab-a3ee-3e4cf98ec4dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054386 Jun 17 13:27:06.360232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2003/3911] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:27:06.513363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:06.514725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:06.522933 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.523650 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.528993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.530876 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.701424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:06.702221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:06.711306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.711908 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.713075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.714838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.858222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.866728 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0f015091-c898-4967-ab32-a54df3f89b85 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.361654 Jun 17 13:27:06.878020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1909/3912] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:06 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:06.878020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:06.878020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:06.881464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.887739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.890600 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.892270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.913488 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.922999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 could not be found. Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 HTTP/1.1 Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:27:06.924732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 could not be found. Jun 17 13:27:06.926364 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '8c79dff5-fa8d-4a6c-9097-833e4b9bfc70'} Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 could not be found. Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:06.927337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 could not be found. Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 could not be found. Jun 17 13:27:06.930404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:06.932515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 404 to user: Instance 8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:06.932515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-04d669e0-ed4c-454b-ad0b-1753804b4576 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70" status: 404 len: 111 microversion: 2.1 time: 0.057474 Jun 17 13:27:06.932726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-602bd6fd-5cd0-4793-9c46-f01ed3e89bef tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.231179 Jun 17 13:27:06.932830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1910/3913] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:06 2022] GET /compute/v2.1/servers/8c79dff5-fa8d-4a6c-9097-833e4b9bfc70 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:27:06.932918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2004/3914] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:06 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:06.941479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:06.941969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:06.948596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.949035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.949853 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.950683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.976175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:27:07.054927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-18d051ae-eece-459f-9f74-2c05e1b8bacb tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "DELETE /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 204 len: 0 microversion: 2.1 time: 0.117012 Jun 17 13:27:07.055958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1911/3915] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:27:06 2022] DELETE /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:27:07.064557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:07.065159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:07.071406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.072016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.072766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.073375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.079867 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:07.080604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:07.087311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.087775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.088573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.089005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.223482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.232905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-601d1d62-bc74-4034-86d5-07331a939dc7 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.172065 Jun 17 13:27:07.234814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2005/3916] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:07 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:07.240756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:07.241932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:07.250153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.250821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.252506 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.253074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.321056 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.335687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.340768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.342482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2da9635a-77e8-491a-8cf6-e99f1c7f425a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1743 microversion: 2.20 time: 0.266937 Jun 17 13:27:07.349147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1912/3917] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:07 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:07.433016 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.452632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1d6a0b57-a318-41d5-9141-89198156c1b2 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.216165 Jun 17 13:27:07.453433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2006/3918] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:07 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:07.488743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-f67c86e8-4e79-4fc0-b628-7cbe7e4869be req-71df6c7d-9251-4086-829d-9abeb934cb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9414346c-91eb-4032-994f-dc957a77a32a", "name": "network-vif-plugged", "status": "completed", "tag": "66e8722c-f8e1-48e8-afde-595e57fc5fbd"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:07.500272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-f67c86e8-4e79-4fc0-b628-7cbe7e4869be req-71df6c7d-9251-4086-829d-9abeb934cb05 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.500948 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-f67c86e8-4e79-4fc0-b628-7cbe7e4869be req-71df6c7d-9251-4086-829d-9abeb934cb05 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.521361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-f67c86e8-4e79-4fc0-b628-7cbe7e4869be req-71df6c7d-9251-4086-829d-9abeb934cb05 service nova] Creating event network-vif-plugged:66e8722c-f8e1-48e8-afde-595e57fc5fbd for instance 9414346c-91eb-4032-994f-dc957a77a32a on hv-cinder-84617 Jun 17 13:27:07.527673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-f67c86e8-4e79-4fc0-b628-7cbe7e4869be req-71df6c7d-9251-4086-829d-9abeb934cb05 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043460 Jun 17 13:27:07.528634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1913/3919] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:07.817405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-94d20036-740d-4aca-875f-7be3dd45a1ef req-433b6b3e-9de5-4c0a-b372-9bd819282daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5737522-b371-4d73-ae95-47ecf041eecc", "tag": "34e7bb02-1f29-4b3d-a984-e96569c0754a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:07.825865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-94d20036-740d-4aca-875f-7be3dd45a1ef req-433b6b3e-9de5-4c0a-b372-9bd819282daf service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.826235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-94d20036-740d-4aca-875f-7be3dd45a1ef req-433b6b3e-9de5-4c0a-b372-9bd819282daf service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.837153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-94d20036-740d-4aca-875f-7be3dd45a1ef req-433b6b3e-9de5-4c0a-b372-9bd819282daf service nova] Creating event network-changed:34e7bb02-1f29-4b3d-a984-e96569c0754a for instance b5737522-b371-4d73-ae95-47ecf041eecc on hv-cinder-84617 Jun 17 13:27:07.841861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-94d20036-740d-4aca-875f-7be3dd45a1ef req-433b6b3e-9de5-4c0a-b372-9bd819282daf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028178 Jun 17 13:27:07.842438 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2007/3920] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:07.901559 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:07.902369 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:07.909281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.910045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.911093 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.911785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.945268 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:07.946079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:07.953503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.954052 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.954825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.955257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.179050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.188050 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-51a98e40-a305-4962-9318-769d6d98a2bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.305762 Jun 17 13:27:08.189251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1914/3921] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:07 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:08.251497 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:08.252105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:08.258090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.258528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.259307 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.260237 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.276527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.286736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9f788683-788c-4900-93de-02fa6632f914 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.346094 Jun 17 13:27:08.296725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2008/3922] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:07 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:08.360705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:08.361720 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:08.368576 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.369442 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.371172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.371862 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.542095 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.551121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.552684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.554555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dbe424bd-2de1-49d6-9fc5-bfdad5c0bb50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.198126 Jun 17 13:27:08.555129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2009/3923] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:08 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:08.560376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:08.560972 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:08.567602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.568040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.568799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.569223 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.802251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.808823 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:08.814207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9b6d4006-e7e4-45be-8467-7641cd52d210 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1319 microversion: 2.1 time: 0.258077 Jun 17 13:27:08.814780 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2010/3924] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:08 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:08.845971 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.853911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-894271ca-d374-42fc-884b-7b893aa644b1 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.606231 Jun 17 13:27:08.854557 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1915/3925] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:08 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:09.205901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:09.206513 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:09.217451 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.219041 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.220076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.221415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.305077 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:09.305694 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:09.313012 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.313715 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.314697 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.315300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.489161 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:09.499003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f9d22968-734f-4511-8d0d-d97164d5a169 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.197669 Jun 17 13:27:09.500231 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1916/3926] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:09 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:09.549517 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-22116ad8-9fc2-49f2-84bf-96f000736acc req-982d7130-242f-41c6-8adb-9632b2b3dd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11", "name": "network-vif-plugged", "status": "completed", "tag": "0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:09.574440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-22116ad8-9fc2-49f2-84bf-96f000736acc req-982d7130-242f-41c6-8adb-9632b2b3dd18 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.574879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-22116ad8-9fc2-49f2-84bf-96f000736acc req-982d7130-242f-41c6-8adb-9632b2b3dd18 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.591214 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-22116ad8-9fc2-49f2-84bf-96f000736acc req-982d7130-242f-41c6-8adb-9632b2b3dd18 service nova] Creating event network-vif-plugged:0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b for instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 on hv-cinder-84617 Jun 17 13:27:09.597781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-22116ad8-9fc2-49f2-84bf-96f000736acc req-982d7130-242f-41c6-8adb-9632b2b3dd18 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051978 Jun 17 13:27:09.598771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1917/3927] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:09.604336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:09.605041 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:09.612572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.613303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.614278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.614899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.785297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:09.798281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:09.801253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:09.802829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-34ec8dea-24b8-41a5-88f7-62f498b3bf1c tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.202711 Jun 17 13:27:09.815297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1918/3928] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:09 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:09.835285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:09.836211 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:09.844254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.844988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.846022 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.847190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.894006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:09.912799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0b522970-5d94-4aba-9daa-3f5c42fb89ac tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.701707 Jun 17 13:27:09.914037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2011/3929] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:09 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:09.919601 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:09.920616 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:09.930502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.931542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.933056 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.933893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.181233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:10.194726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-78543ea1-15e1-4105-ba2e-2c3ee7aedc13 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1509 microversion: 2.1 time: 0.365917 Jun 17 13:27:10.196283 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1919/3930] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:09 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:10.199313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:10.208321 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9d1fea39-34fe-4886-9f28-197987d82cca tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1520 microversion: 2.1 time: 0.292913 Jun 17 13:27:10.208914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2012/3931] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:09 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:10.224615 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-edbe4044-6a5c-4133-9b77-0db6af661a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c85f9b3-1344-44ff-a6fe-7122173a8b77", "device": "/dev/sdb"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:10.228689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-edbe4044-6a5c-4133-9b77-0db6af661a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:10.236944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-edbe4044-6a5c-4133-9b77-0db6af661a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.237611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-edbe4044-6a5c-4133-9b77-0db6af661a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.238607 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-edbe4044-6a5c-4133-9b77-0db6af661a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.239040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-edbe4044-6a5c-4133-9b77-0db6af661a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.505492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-5e6c3e8e-204b-470b-99e1-96e2e6340e6a req-bb092935-3bdc-4890-919e-c39731df94d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d77c9b-4a5f-469d-9a72-ced7b26a4138", "name": "network-vif-deleted", "tag": "d72f5648-68ed-4330-b798-01859fad53c5"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:10.517841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-5e6c3e8e-204b-470b-99e1-96e2e6340e6a req-bb092935-3bdc-4890-919e-c39731df94d7 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.520018 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-5e6c3e8e-204b-470b-99e1-96e2e6340e6a req-bb092935-3bdc-4890-919e-c39731df94d7 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.545424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-5e6c3e8e-204b-470b-99e1-96e2e6340e6a req-bb092935-3bdc-4890-919e-c39731df94d7 service nova] Creating event network-vif-deleted:d72f5648-68ed-4330-b798-01859fad53c5 for instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 on hv-cinder-84617 Jun 17 13:27:10.554055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-5e6c3e8e-204b-470b-99e1-96e2e6340e6a req-bb092935-3bdc-4890-919e-c39731df94d7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052428 Jun 17 13:27:10.555361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2013/3932] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:10.561890 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:10.562821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:10.569465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.570217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.571214 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.571938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.629004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-edbe4044-6a5c-4133-9b77-0db6af661a0d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "POST /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418950 Jun 17 13:27:10.630923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1920/3933] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 13:27:10 2022] POST /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:10.823813 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:10.824511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:10.848127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.848826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.849352 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.849787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.886717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:10.905428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bd550109-4698-44f3-896d-d53cc33d7fc7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.348533 Jun 17 13:27:10.920778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2014/3934] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:10 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:10.940304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:10.942151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:10.962326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.962933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.963831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.965541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.054866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.064875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.067435 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.069120 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8356e257-d459-4ab7-989f-ca593d783690 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.250516 Jun 17 13:27:11.069982 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1921/3935] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:10 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:11.136562 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.144713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0903c578-68d6-4655-ab2c-c9475cdb2348 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.209858 Jun 17 13:27:11.154684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2015/3936] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:10 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:11.232243 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:11.232960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:11.240154 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.240915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.241898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.242552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.248727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:11.282609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.283425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.284031 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lazy-loading 'fault' on Instance uuid 05d77c9b-4a5f-469d-9a72-ced7b26a4138 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:11.333481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efee42b434cd47d99984b85f677983c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba886227347427bb1cbce939509be05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.342117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ddc27296-bbb9-4c72-8dee-134fa501fdf4 tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 200 len: 1310 microversion: 2.1 time: 0.113816 Jun 17 13:27:11.343465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1922/3937] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:11 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 1310 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:11.939945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:11.941337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:11.948943 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.949317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.950086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.950522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.090393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:12.091039 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:12.101663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.102607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.107994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.109330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.117799 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-be015c3c-bbd3-46fd-8023-fe87a82fe5b7 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.181791 Jun 17 13:27:12.119266 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2016/3938] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:11 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:12.120530 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.162878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:12.163844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:12.169985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.170427 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.171609 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.172038 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.308149 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.319910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.321663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.322909 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7e6d785c-bb33-45e0-99a1-cb60ecac0ad1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.238025 Jun 17 13:27:12.323489 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1923/3939] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:12 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:12.340190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.348311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d8c096eb-a6ba-4181-8d03-bd4e08ba1fda tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.190088 Jun 17 13:27:12.350514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2017/3940] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:12 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:12.361941 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:12.362550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] [instance: 05d77c9b-4a5f-469d-9a72-ced7b26a4138] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:12.369038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.369479 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.370342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.370768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.387590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] HTTP exception thrown: Instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 could not be found. Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Request method failure captured: Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 HTTP/1.1 Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjfZJJrZUvahbQUXZnztmP_E2fD4GhiC-HMUk-MmQXhrbwfUgO58EFlUQAJALCFpWBEElQjeSpILJfWvA63nYDnhda5y-uUugGyJO9xvx4cb6cEKY9UiKavlNjHhVpclI1hUK4jtiP3aEdGpLYkqw2X0C5t432sNw5aBH-3V39Zs0M Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:27:12.389375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8ba886227347427bb1cbce939509be05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8ba886227347427bb1cbce939509be05", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8ba886227347427bb1cbce939509be05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8ba886227347427bb1cbce939509be05 Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1139693893 Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: efee42b434cd47d99984b85f677983c2 Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1139693893-project Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 could not be found. Jun 17 13:27:12.391206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '05d77c9b-4a5f-469d-9a72-ced7b26a4138'} Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 could not be found. Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:12.392274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 could not be found. Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 could not be found. Jun 17 13:27:12.394108 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:12.395893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] Returning 404 to user: Instance 05d77c9b-4a5f-469d-9a72-ced7b26a4138 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:12.395893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-07ae04ec-bc93-4c87-a4af-8e420031847f tempest-ServerRescueNegativeTestJSON-1139693893 tempest-ServerRescueNegativeTestJSON-1139693893-project] 10.222.0.87 "GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138" status: 404 len: 111 microversion: 2.1 time: 0.033326 Jun 17 13:27:12.395893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1924/3941] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:12 2022] GET /compute/v2.1/servers/05d77c9b-4a5f-469d-9a72-ced7b26a4138 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:27:13.135496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:13.136921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:13.144312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.145062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.146069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.146963 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.321024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.332445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0635f770-d289-4cb1-be8c-af5ea172e264 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.201018 Jun 17 13:27:13.333656 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2018/3942] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:13 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:13.341323 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:13.342288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:13.344672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:13.345623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=12 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:13.361048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.362468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.365367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.368097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.369946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:13.371197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:13.381939 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.384565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.385840 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.386500 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.626102 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.626796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.636259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d3119435-3a28-4213-a1ee-0058efcbbc12 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.273923 Jun 17 13:27:13.636927 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2019/3943] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:13 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:13.638261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.641923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.642263 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-f1f3588b-68e0-474e-a62e-1ae05336f509 req-03cd79b9-11a9-4fa1-a132-95bbc9c6bad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea25a26b-5528-4263-b959-666f40e187ac", "name": "network-vif-plugged", "status": "completed", "tag": "f3a69d0d-98d4-490c-acb7-38f8368c1bd0"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:13.646225 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-06425dcb-5208-400b-af30-14c433206968 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.309035 Jun 17 13:27:13.646787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1925/3944] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:13 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:13.653317 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-f1f3588b-68e0-474e-a62e-1ae05336f509 req-03cd79b9-11a9-4fa1-a132-95bbc9c6bad9 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.653755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-f1f3588b-68e0-474e-a62e-1ae05336f509 req-03cd79b9-11a9-4fa1-a132-95bbc9c6bad9 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.665188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-f1f3588b-68e0-474e-a62e-1ae05336f509 req-03cd79b9-11a9-4fa1-a132-95bbc9c6bad9 service nova] Creating event network-vif-plugged:f3a69d0d-98d4-490c-acb7-38f8368c1bd0 for instance ea25a26b-5528-4263-b959-666f40e187ac on hv-cinder-84617 Jun 17 13:27:13.670895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-f1f3588b-68e0-474e-a62e-1ae05336f509 req-03cd79b9-11a9-4fa1-a132-95bbc9c6bad9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032641 Jun 17 13:27:13.673110 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2020/3945] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:14.355095 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:14.356248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:14.373025 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.373789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.378461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.380978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.583416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.597219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-90aaa651-340d-441a-a9cb-d90a7ab0eff4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1362 microversion: 2.1 time: 0.250827 Jun 17 13:27:14.599676 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1926/3946] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:14 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:14.668974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:14.672172 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:14.674175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:14.674998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:14.696029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.696472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.697422 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.697851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.702319 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=4 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:14.705612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=20 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:14.711011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.716115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.718128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.718844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.929632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.938732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.940610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.941994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fe49e2ad-a8a7-4b07-b3d9-40ecfdbe4a2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.279474 Jun 17 13:27:14.942727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1927/3947] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:14 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:15.098548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:15.105868 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8d49a2c3-8c0a-4c97-9e9e-f57458abe1bd tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.456141 Jun 17 13:27:15.106457 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2021/3948] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:14 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:15.615287 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:15.617189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:15.628923 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.631023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.632020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.635796 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.889621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:15.913553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a613d279-d768-46cd-bc6a-87cd53f9995f tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1547 microversion: 2.1 time: 0.299005 Jun 17 13:27:15.916616 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1928/3949] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:15 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1547 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:15.935175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bd84e8ec-78d8-42fd-b3f7-6e99f5df550e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:15.936406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bd84e8ec-78d8-42fd-b3f7-6e99f5df550e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:15.956422 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd84e8ec-78d8-42fd-b3f7-6e99f5df550e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.958619 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd84e8ec-78d8-42fd-b3f7-6e99f5df550e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.962950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd84e8ec-78d8-42fd-b3f7-6e99f5df550e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.963105 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:15.963745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd84e8ec-78d8-42fd-b3f7-6e99f5df550e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.965633 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:15.993983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.995011 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.999023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.999664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.136497 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bd84e8ec-78d8-42fd-b3f7-6e99f5df550e tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205191 Jun 17 13:27:16.137404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2022/3950] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 13:27:15 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:16.142965 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:16.143955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:16.161306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.162086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.163946 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.164658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.392433 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.405496 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.407460 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.410070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-becaf87f-32ed-4db6-bde2-b919aea27513 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.452942 Jun 17 13:27:16.410477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1929/3951] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:15 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:16.745252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.793445 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2700d707-671d-4800-b2a3-504b8b8ce9b7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.647405 Jun 17 13:27:16.794163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2023/3952] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:16 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:17.436178 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:17.437978 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:17.446542 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.448098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.449484 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.450111 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.486112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-4f2ba12c-2bcf-4701-8e31-6855aa798f4e req-10ce793b-f29a-4161-99c3-1498e489b2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5737522-b371-4d73-ae95-47ecf041eecc", "name": "network-vif-plugged", "status": "completed", "tag": "34e7bb02-1f29-4b3d-a984-e96569c0754a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:17.517754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4f2ba12c-2bcf-4701-8e31-6855aa798f4e req-10ce793b-f29a-4161-99c3-1498e489b2ec service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.524624 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-4f2ba12c-2bcf-4701-8e31-6855aa798f4e req-10ce793b-f29a-4161-99c3-1498e489b2ec service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.560143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-4f2ba12c-2bcf-4701-8e31-6855aa798f4e req-10ce793b-f29a-4161-99c3-1498e489b2ec service nova] Creating event network-vif-plugged:34e7bb02-1f29-4b3d-a984-e96569c0754a for instance b5737522-b371-4d73-ae95-47ecf041eecc on hv-cinder-84617 Jun 17 13:27:17.592126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-4f2ba12c-2bcf-4701-8e31-6855aa798f4e req-10ce793b-f29a-4161-99c3-1498e489b2ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115517 Jun 17 13:27:17.599481 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2024/3953] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:17.676389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.698785 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.701315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.702981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f1424ee4-dd8d-40c0-9693-09a721ab28ce tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.277746 Jun 17 13:27:17.704183 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1930/3954] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:17 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:17.812564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:17.813527 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:17.827215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.830193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.834369 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.835143 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.120825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:18.130131 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-db1077ae-673e-4773-9be1-180a9b76a2a6 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.323517 Jun 17 13:27:18.134482 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2025/3955] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:17 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:18.412908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-df045ef7-d50b-41a0-8926-c5eacb202b7c req-5e9a088f-7b9f-4955-9cf7-6142c31672e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea25a26b-5528-4263-b959-666f40e187ac", "tag": "f3a69d0d-98d4-490c-acb7-38f8368c1bd0"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:18.422678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-df045ef7-d50b-41a0-8926-c5eacb202b7c req-5e9a088f-7b9f-4955-9cf7-6142c31672e3 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.423498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-df045ef7-d50b-41a0-8926-c5eacb202b7c req-5e9a088f-7b9f-4955-9cf7-6142c31672e3 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.443201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-df045ef7-d50b-41a0-8926-c5eacb202b7c req-5e9a088f-7b9f-4955-9cf7-6142c31672e3 service nova] Creating event network-changed:f3a69d0d-98d4-490c-acb7-38f8368c1bd0 for instance ea25a26b-5528-4263-b959-666f40e187ac on hv-cinder-84617 Jun 17 13:27:18.449955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-df045ef7-d50b-41a0-8926-c5eacb202b7c req-5e9a088f-7b9f-4955-9cf7-6142c31672e3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041177 Jun 17 13:27:18.454713 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1931/3956] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:18.723661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:18.726126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:18.741221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.741745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.744919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.745449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:19.102875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:19.120318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:19.122400 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:19.123839 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c42e55c5-2c4f-47e2-a745-d11e5d0742e8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.405545 Jun 17 13:27:19.125029 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2026/3957] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:18 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:19.151550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:19.152569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:19.168351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:19.169245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:19.170240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:19.170875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:19.439932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:19.455356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2eaead56-f45b-403f-a3fc-e1a6df093e47 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1366 microversion: 2.1 time: 0.305104 Jun 17 13:27:19.464195 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1932/3958] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:19 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:19.887612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7a103569-595c-4ee8-8160-39990a628b76 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Action: 'create', calling method: .version_select at 0x7f454e905670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-625790028", "metadata": {"Type": "work"}}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7a103569-595c-4ee8-8160-39990a628b76 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Request method failure captured: Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 121 Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirIE3aN2UoH_k6u77xI9OTs-MGEnkPPoSIOdd06AW4GT5MYYKljaA_CLjX9nxjF9I0f2FgRbyJUJPj8M30pALrbCwWBmzU_9jokSz5zIRp8ov1HmGxPJhx3GHnB3fkXJUwNiD7YVpA9VLKTlhMfthMa5iNlaI51LZZz3_LncbQZ3to6Q Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:27:19.906064 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/253055dcc428497a9b47aee968f37853"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_253055dcc428497a9b47aee968f37853", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: db86014c66214f07ac865963bcc28bda Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-625790028", "metadata": {"Type": "work"}}} Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: Jun 17 13:27:19.908153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-625790028', 'metadata': {'Type': 'work'}}}} Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise error Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:19.909272 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 13:27:19.911271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 13:27:19.912936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 13:27:19.912936 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.914215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7a103569-595c-4ee8-8160-39990a628b76 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:19.915083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7a103569-595c-4ee8-8160-39990a628b76 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.290981 Jun 17 13:27:19.916019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2027/3959] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Jun 17 13:27:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:27:19.929260 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c20920cd-1cbb-4622-90f5-9bfe42e7c0fb tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Action: 'create', calling method: .version_select at 0x7f45531355e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-933136938", "metadata": {"Type": "work"}}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c20920cd-1cbb-4622-90f5-9bfe42e7c0fb tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Request method failure captured: Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 119 Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIE3aN2UoH_k6u77xI9OTs-MGEnkPPoSIOdd06AW4GT5MYYKljaA_CLjX9nxjF9I0f2FgRbyJUJPj8M30pALrbCwWBmzU_9jokSz5zIRp8ov1HmGxPJhx3GHnB3fkXJUwNiD7YVpA9VLKTlhMfthMa5iNlaI51LZZz3_LncbQZ3to6Q Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:27:19.935915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/253055dcc428497a9b47aee968f37853"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_253055dcc428497a9b47aee968f37853", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: db86014c66214f07ac865963bcc28bda Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-933136938", "metadata": {"Type": "work"}}} Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: Jun 17 13:27:19.937523 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-933136938', 'metadata': {'Type': 'work'}}}} Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise error Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi '0' Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:19.938427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 13:27:19.940620 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 13:27:19.942058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 13:27:19.942058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.942058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c20920cd-1cbb-4622-90f5-9bfe42e7c0fb tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:19.942058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c20920cd-1cbb-4622-90f5-9bfe42e7c0fb tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015863 Jun 17 13:27:19.943302 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1933/3960] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Jun 17 13:27:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 13:27:19.948288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ac31f4f-04c3-4269-b5c5-0e0058041314 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Action: 'create', calling method: .version_select at 0x7f45530bda60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1316438812", "metadata": {"Type": "work"}}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ac31f4f-04c3-4269-b5c5-0e0058041314 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Request method failure captured: Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 119 Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirIE3aN2UoH_k6u77xI9OTs-MGEnkPPoSIOdd06AW4GT5MYYKljaA_CLjX9nxjF9I0f2FgRbyJUJPj8M30pALrbCwWBmzU_9jokSz5zIRp8ov1HmGxPJhx3GHnB3fkXJUwNiD7YVpA9VLKTlhMfthMa5iNlaI51LZZz3_LncbQZ3to6Q Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:27:19.953408 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/253055dcc428497a9b47aee968f37853"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_253055dcc428497a9b47aee968f37853", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: db86014c66214f07ac865963bcc28bda Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1316438812", "metadata": {"Type": "work"}}} Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: Jun 17 13:27:19.955060 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1316438812', 'metadata': {'Type': 'work'}}}} Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise error Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi '' Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:19.960912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 13:27:19.963801 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 13:27:19.967010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 13:27:19.967010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:19.967010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ac31f4f-04c3-4269-b5c5-0e0058041314 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:19.967010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5ac31f4f-04c3-4269-b5c5-0e0058041314 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010768 Jun 17 13:27:19.967010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2028/3961] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Jun 17 13:27:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:27:19.967910 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cf2e7c32-aacd-471d-84fd-f4491ccb1809 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Calling method '.version_select at 0x7f454ea68430>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.022234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-cf2e7c32-aacd-471d-84fd-f4491ccb1809 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] HTTP exception thrown: Volume tempest-invalid-775300777 could not be found. Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cf2e7c32-aacd-471d-84fd-f4491ccb1809 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Request method failure captured: Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-775300777 HTTP/1.1 Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIE3aN2UoH_k6u77xI9OTs-MGEnkPPoSIOdd06AW4GT5MYYKljaA_CLjX9nxjF9I0f2FgRbyJUJPj8M30pALrbCwWBmzU_9jokSz5zIRp8ov1HmGxPJhx3GHnB3fkXJUwNiD7YVpA9VLKTlhMfthMa5iNlaI51LZZz3_LncbQZ3to6Q Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:27:20.025698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/253055dcc428497a9b47aee968f37853"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_253055dcc428497a9b47aee968f37853", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: db86014c66214f07ac865963bcc28bda Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Volume tempest-invalid-775300777 could not be found. Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'tempest-invalid-775300777'} Jun 17 13:27:20.027289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-775300777 could not be found. (HTTP 404) (Request-ID: req-ad21e38c-81af-4c3a-ac08-0c090e782ede) Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.028404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 13:27:20.029846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-775300777 could not be found. Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:27:20.031202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-775300777 could not be found. Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-775300777 could not be found. Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cf2e7c32-aacd-471d-84fd-f4491ccb1809 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Returning 404 to user: Volume tempest-invalid-775300777 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cf2e7c32-aacd-471d-84fd-f4491ccb1809 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/tempest-invalid-775300777" status: 404 len: 98 microversion: 2.1 time: 0.065487 Jun 17 13:27:20.034036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1934/3962] 10.222.0.87 () {58 vars in 1214 bytes} [Fri Jun 17 13:27:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-775300777 => generated 98 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 17 13:27:20.036859 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-287a942d-c07f-4a32-b876-7bb7b7337a84 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003812 Jun 17 13:27:20.037370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2029/3963] 10.222.0.87 () {58 vars in 1139 bytes} [Fri Jun 17 13:27:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 17 13:27:20.047565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-85fc54e6-5f34-47b4-8f0d-39e9cf9a8df3 tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003786 Jun 17 13:27:20.053700 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1935/3964] 10.222.0.87 () {58 vars in 1136 bytes} [Fri Jun 17 13:27:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 13:27:20.061185 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-934ce49c-e014-4214-a033-f0041961e23c tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Calling method '.version_select at 0x7f454e905e50>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.115439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-934ce49c-e014-4214-a033-f0041961e23c tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] HTTP exception thrown: Volume 5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a could not be found. Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-934ce49c-e014-4214-a033-f0041961e23c tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Request method failure captured: Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/os-volumes/5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a HTTP/1.1 Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirIE3aN2UoH_k6u77xI9OTs-MGEnkPPoSIOdd06AW4GT5MYYKljaA_CLjX9nxjF9I0f2FgRbyJUJPj8M30pALrbCwWBmzU_9jokSz5zIRp8ov1HmGxPJhx3GHnB3fkXJUwNiD7YVpA9VLKTlhMfthMa5iNlaI51LZZz3_LncbQZ3to6Q Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:27:20.117707 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/253055dcc428497a9b47aee968f37853"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_253055dcc428497a9b47aee968f37853", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: db86014c66214f07ac865963bcc28bda Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Volume 5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a could not be found. Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a'} Jun 17 13:27:20.119897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a could not be found. (HTTP 404) (Request-ID: req-822e6046-96da-4ffc-bfb0-8f14bf400312) Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.121446 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 13:27:20.122753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a could not be found. Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 13:27:20.124221 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a could not be found. Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a could not be found. Jun 17 13:27:20.125889 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.129745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-934ce49c-e014-4214-a033-f0041961e23c tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Returning 404 to user: Volume 5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:20.129745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-934ce49c-e014-4214-a033-f0041961e23c tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a" status: 404 len: 109 microversion: 2.1 time: 0.073696 Jun 17 13:27:20.129745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2030/3965] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:27:20 2022] DELETE /compute/v2.1/os-volumes/5ae6e6d7-d60f-4ce7-97bc-fc3b27207d5a => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:27:20.138974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1bf6fb3-ccd4-45c6-8100-900765690f8f tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Calling method '.version_select at 0x7f45531355e0>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.149069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.152123 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:20.161178 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.161988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.163206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.163930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.199734 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-e1bf6fb3-ccd4-45c6-8100-900765690f8f tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] HTTP exception thrown: Volume 58899f47-3f85-4888-9cb8-586a5e19e0c9 could not be found. Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1bf6fb3-ccd4-45c6-8100-900765690f8f tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Request method failure captured: Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/os-volumes/58899f47-3f85-4888-9cb8-586a5e19e0c9 HTTP/1.1 Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIE3aN2UoH_k6u77xI9OTs-MGEnkPPoSIOdd06AW4GT5MYYKljaA_CLjX9nxjF9I0f2FgRbyJUJPj8M30pALrbCwWBmzU_9jokSz5zIRp8ov1HmGxPJhx3GHnB3fkXJUwNiD7YVpA9VLKTlhMfthMa5iNlaI51LZZz3_LncbQZ3to6Q Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:27:20.201768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/253055dcc428497a9b47aee968f37853"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_253055dcc428497a9b47aee968f37853", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/253055dcc428497a9b47aee968f37853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 253055dcc428497a9b47aee968f37853 Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesNegativeTest-1290306543 Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: db86014c66214f07ac865963bcc28bda Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesNegativeTest-1290306543-project Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Volume 58899f47-3f85-4888-9cb8-586a5e19e0c9 could not be found. Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '58899f47-3f85-4888-9cb8-586a5e19e0c9'} Jun 17 13:27:20.203472 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58899f47-3f85-4888-9cb8-586a5e19e0c9 could not be found. (HTTP 404) (Request-ID: req-f1a6c76f-964d-4265-8919-6d3daecf9563) Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.204407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:27:20.205784 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58899f47-3f85-4888-9cb8-586a5e19e0c9 could not be found. Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 13:27:20.208740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58899f47-3f85-4888-9cb8-586a5e19e0c9 could not be found. Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58899f47-3f85-4888-9cb8-586a5e19e0c9 could not be found. Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e1bf6fb3-ccd4-45c6-8100-900765690f8f tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] Returning 404 to user: Volume 58899f47-3f85-4888-9cb8-586a5e19e0c9 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e1bf6fb3-ccd4-45c6-8100-900765690f8f tempest-VolumesNegativeTest-1290306543 tempest-VolumesNegativeTest-1290306543-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/58899f47-3f85-4888-9cb8-586a5e19e0c9" status: 404 len: 109 microversion: 2.1 time: 0.069314 Jun 17 13:27:20.212441 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1936/3966] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:27:20 2022] GET /compute/v2.1/os-volumes/58899f47-3f85-4888-9cb8-586a5e19e0c9 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:27:20.354100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.363326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.365065 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.366485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fa51b823-a482-42e9-9a1a-78123aa0a6c1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.228261 Jun 17 13:27:20.367354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2031/3967] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:20 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:20.475250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.476447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:20.485272 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.485725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.486511 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.486945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.650740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.660913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-12f82754-ff63-42be-a443-c95bd086ccb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1555 microversion: 2.1 time: 0.191668 Jun 17 13:27:20.664521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1937/3968] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:20 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:20.680548 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e0419978-3400-48ed-bbb6-90314ce6d3af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.681384 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e0419978-3400-48ed-bbb6-90314ce6d3af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:20.688791 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0419978-3400-48ed-bbb6-90314ce6d3af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.689492 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0419978-3400-48ed-bbb6-90314ce6d3af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.690334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0419978-3400-48ed-bbb6-90314ce6d3af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.691019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e0419978-3400-48ed-bbb6-90314ce6d3af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.809496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e0419978-3400-48ed-bbb6-90314ce6d3af tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134465 Jun 17 13:27:20.810098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2032/3969] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Jun 17 13:27:20 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:21.385046 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:21.386013 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:21.400142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.400963 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.401988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.402417 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.721062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.730908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.732901 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.735239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bad5f75e-0c19-4de5-8c27-e1c34877d068 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1738 microversion: 2.20 time: 0.354289 Jun 17 13:27:21.735925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1938/3970] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:21 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:22.308805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-0bc0104d-fbb9-44a4-b1ad-1f2f4890f602 req-49d30603-2585-4134-9671-7d52cc672ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5737522-b371-4d73-ae95-47ecf041eecc", "tag": "34e7bb02-1f29-4b3d-a984-e96569c0754a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:22.317945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-0bc0104d-fbb9-44a4-b1ad-1f2f4890f602 req-49d30603-2585-4134-9671-7d52cc672ce6 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.318551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-0bc0104d-fbb9-44a4-b1ad-1f2f4890f602 req-49d30603-2585-4134-9671-7d52cc672ce6 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.332992 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-0bc0104d-fbb9-44a4-b1ad-1f2f4890f602 req-49d30603-2585-4134-9671-7d52cc672ce6 service nova] Creating event network-changed:34e7bb02-1f29-4b3d-a984-e96569c0754a for instance b5737522-b371-4d73-ae95-47ecf041eecc on hv-cinder-84617 Jun 17 13:27:22.338800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-0bc0104d-fbb9-44a4-b1ad-1f2f4890f602 req-49d30603-2585-4134-9671-7d52cc672ce6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034658 Jun 17 13:27:22.343071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2033/3971] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:22.758896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:22.760246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:22.770984 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.771463 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.772230 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.772891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.937305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.947129 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.949034 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.950491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f6ab3775-af6c-407f-86d7-88478aa30d8b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1720 microversion: 2.20 time: 0.196274 Jun 17 13:27:22.952487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1939/3972] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:22 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:23.971083 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:23.971805 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:23.978519 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.979011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:23.979878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.980314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:24.193426 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.197683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=100 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:24.204158 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.205665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.206830 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-306ea02c-4104-4131-b326-6e1d207b96cd tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1720 microversion: 2.20 time: 0.240775 Jun 17 13:27:24.207690 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2034/3973] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:23 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:25.225673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:25.226258 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:25.233297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.234081 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:25.234856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.235281 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:25.378879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:25.387412 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:25.388891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:25.390045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b5438955-ce2c-4891-8b67-30a5c36090b9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1720 microversion: 2.20 time: 0.168416 Jun 17 13:27:25.390610 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1940/3974] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:25 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:26.408615 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:26.409188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:26.411882 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:26.417961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:26.418444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:26.419262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:26.419716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:26.551405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.565926 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.567530 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.568713 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-87e5c25d-6031-40e2-bfb0-8b20a5dc3bde tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1720 microversion: 2.20 time: 0.164030 Jun 17 13:27:26.569274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2035/3975] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:26 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:27.364782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-1a049f72-893b-46cd-b20a-8af18f0e9150 req-c45f9b67-1801-4c5b-9511-c95e6fac099e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11", "name": "network-vif-unplugged", "status": "completed", "tag": "0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:27.376083 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-1a049f72-893b-46cd-b20a-8af18f0e9150 req-c45f9b67-1801-4c5b-9511-c95e6fac099e service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.377452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-1a049f72-893b-46cd-b20a-8af18f0e9150 req-c45f9b67-1801-4c5b-9511-c95e6fac099e service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.394193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.compute.server_external_events [req-1a049f72-893b-46cd-b20a-8af18f0e9150 req-c45f9b67-1801-4c5b-9511-c95e6fac099e service nova] Unable to find a host for instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11. Dropping event network-vif-unplugged {{(pid=134351) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 13:27:27.396060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-1a049f72-893b-46cd-b20a-8af18f0e9150 req-c45f9b67-1801-4c5b-9511-c95e6fac099e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035745 Jun 17 13:27:27.397064 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1941/3976] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 13:27:27.589173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:27.589766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:27.597040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.597522 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.598348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.598809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.754077 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.767577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.769020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.770167 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c7fddaa7-d96e-4c46-8abc-ae0fa3980a4a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1663 microversion: 2.20 time: 0.185379 Jun 17 13:27:27.770739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2036/3977] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:27 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1663 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:27.789008 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fb1198dd-9cf7-47b1-ada5-c2b4bcb92e33 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cb6dc7d-4b48-40f2-8d55-a778fc1e21e6"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:27.790059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-fb1198dd-9cf7-47b1-ada5-c2b4bcb92e33 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:27.796644 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb1198dd-9cf7-47b1-ada5-c2b4bcb92e33 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.797089 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb1198dd-9cf7-47b1-ada5-c2b4bcb92e33 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.797826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb1198dd-9cf7-47b1-ada5-c2b4bcb92e33 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.798279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-fb1198dd-9cf7-47b1-ada5-c2b4bcb92e33 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.008552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:28.102798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fb1198dd-9cf7-47b1-ada5-c2b4bcb92e33 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317774 Jun 17 13:27:28.103318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1942/3978] 10.222.0.87 () {62 vars in 1363 bytes} [Fri Jun 17 13:27:27 2022] POST /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:27:28.224258 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0480dba0-ed0f-4237-bbc1-73ebceb024d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:28.224745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0480dba0-ed0f-4237-bbc1-73ebceb024d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:28.231403 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0480dba0-ed0f-4237-bbc1-73ebceb024d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.231901 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0480dba0-ed0f-4237-bbc1-73ebceb024d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.232742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0480dba0-ed0f-4237-bbc1-73ebceb024d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.233149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0480dba0-ed0f-4237-bbc1-73ebceb024d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.508191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0480dba0-ed0f-4237-bbc1-73ebceb024d8 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-volume_attachments/1cb6dc7d-4b48-40f2-8d55-a778fc1e21e6" status: 202 len: 0 microversion: 2.20 time: 0.288009 Jun 17 13:27:28.508947 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2037/3979] 10.222.0.87 () {60 vars in 1456 bytes} [Fri Jun 17 13:27:28 2022] DELETE /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-volume_attachments/1cb6dc7d-4b48-40f2-8d55-a778fc1e21e6 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:27:28.575452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8f9591ba-7971-4dce-a0d6-96b2640ddc98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:28.575913 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8f9591ba-7971-4dce-a0d6-96b2640ddc98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:28.582965 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f9591ba-7971-4dce-a0d6-96b2640ddc98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.583637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f9591ba-7971-4dce-a0d6-96b2640ddc98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.584414 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f9591ba-7971-4dce-a0d6-96b2640ddc98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.584844 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8f9591ba-7971-4dce-a0d6-96b2640ddc98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.636908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:28.698104 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8f9591ba-7971-4dce-a0d6-96b2640ddc98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "POST /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/action" status: 202 len: 0 microversion: 2.20 time: 0.127428 Jun 17 13:27:28.702603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1943/3980] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Jun 17 13:27:28 2022] POST /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:27:28.708286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:28.709581 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:28.718606 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.719240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.720125 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.720597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.883032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.893367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.894865 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.896071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bb10125f-2cc6-461d-bf28-dd16d92a0349 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1671 microversion: 2.20 time: 0.192538 Jun 17 13:27:28.896631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2038/3981] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:28 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:29.683253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:29.683894 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:29.690667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.691112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.691938 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.692399 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.777797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'services' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:29.868896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7e453cd7-fe1e-472f-8351-ead31d874669 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a/os-volume_attachments/7c85f9b3-1344-44ff-a6fe-7122173a8b77" status: 202 len: 0 microversion: 2.1 time: 0.189908 Jun 17 13:27:29.869851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1944/3982] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:27:29 2022] DELETE /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a/os-volume_attachments/7c85f9b3-1344-44ff-a6fe-7122173a8b77 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:27:29.915850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:29.916572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:29.923610 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.924032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.933191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.933715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:30.081247 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:30.090151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:30.091661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:30.092849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8d93c657-f7c7-4aea-bdba-dc6763bf0e16 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1671 microversion: 2.20 time: 0.181191 Jun 17 13:27:30.093416 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2039/3983] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:29 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:30.996168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:30.996751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:31.003289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.003757 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.004519 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.004943 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.032742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:27:31.112849 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:31.114152 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:31.123846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.127335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.131443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.134068 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e9aa9527-3e3b-424a-bfab-a4f2ae7462f5 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 204 len: 0 microversion: 2.1 time: 0.142166 Jun 17 13:27:31.134663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1945/3984] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:27:30 2022] DELETE /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:27:31.136213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.155631 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:31.156761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:31.164454 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.164960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.165834 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.166835 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.303642 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.312518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.313985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.315138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2ac9874a-42cc-4c5b-9f64-1fac47aad469 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.207034 Jun 17 13:27:31.315719 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2040/3985] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:31 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:31.351020 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.361595 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8847ada0-e0e9-4b6d-b31e-d516b90fc65a tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1515 microversion: 2.1 time: 0.220120 Jun 17 13:27:31.362455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1946/3986] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:31 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:32.334514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:32.335637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:32.342838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.343328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.344120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.344658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.386513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:32.387725 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:32.399336 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.400132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.401608 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.402379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.570869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.584561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.584898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-37777a39-9d9a-497f-8b87-27e1cea285bc tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1515 microversion: 2.1 time: 0.205368 Jun 17 13:27:32.585669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1947/3987] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:32 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:32.593062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.594559 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.595974 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-34af6991-7205-46bb-93cf-3bef7e72b2de tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.265956 Jun 17 13:27:32.596821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2041/3988] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:32 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:33.432751 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-0c80ae08-61e2-42a1-81ad-3e0e5f8db3ee req-381d6d2d-334c-40d3-bb10-9d1244de006c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9414346c-91eb-4032-994f-dc957a77a32a", "name": "network-vif-deleted", "tag": "66e8722c-f8e1-48e8-afde-595e57fc5fbd"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:33.442768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0c80ae08-61e2-42a1-81ad-3e0e5f8db3ee req-381d6d2d-334c-40d3-bb10-9d1244de006c service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.443261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-0c80ae08-61e2-42a1-81ad-3e0e5f8db3ee req-381d6d2d-334c-40d3-bb10-9d1244de006c service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.455997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-0c80ae08-61e2-42a1-81ad-3e0e5f8db3ee req-381d6d2d-334c-40d3-bb10-9d1244de006c service nova] Creating event network-vif-deleted:66e8722c-f8e1-48e8-afde-595e57fc5fbd for instance 9414346c-91eb-4032-994f-dc957a77a32a on hv-cinder-84617 Jun 17 13:27:33.461596 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-0c80ae08-61e2-42a1-81ad-3e0e5f8db3ee req-381d6d2d-334c-40d3-bb10-9d1244de006c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032800 Jun 17 13:27:33.466407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1948/3989] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:27:33.602381 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:33.602986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:33.616886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:33.617589 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.617932 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:33.618508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.619421 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.619899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.631723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.638098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.646985 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.647856 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.698425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.698866 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.699329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:33.766697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.776076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d720959c-3346-4e34-9a8b-198210a1bfac tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.177317 Jun 17 13:27:33.787325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2042/3990] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:33 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:33.918365 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.926920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.928866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.930324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47260969-5c10-431a-80d4-4647362e1759 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.319067 Jun 17 13:27:33.942060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1949/3991] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:33 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:34.794322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:34.795047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:34.802605 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.803058 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.803884 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.804322 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.843404 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.844511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.845148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:34.889553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:34.898249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fc439a8b-cfc0-4491-a43d-27e117d6233d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.107953 Jun 17 13:27:34.903420 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2043/3992] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:34 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:34.950550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:34.951202 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:34.958334 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.958945 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.959780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.960222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.153067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.161890 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.163968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.165483 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8219ebc6-6499-4c5a-9c81-e7fa5c730b2b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.220130 Jun 17 13:27:35.171491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1950/3993] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:34 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:35.915918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:35.917340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:35.924411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.925159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.925934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.926370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.959810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.960262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.960710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:36.018298 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.027848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-162130da-db09-46d1-9d90-3bde0b3e32aa tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.115830 Jun 17 13:27:36.029252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2044/3994] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:35 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:36.185708 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:36.186986 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:36.194289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.194743 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.195544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.195981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.344363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.355088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.357221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.358968 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-63cccb86-cf0d-4acc-84cc-2f5e614f0b70 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.177132 Jun 17 13:27:36.359724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1951/3995] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:36 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:37.053392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:37.054112 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:37.061316 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.061756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.062550 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.062979 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.096367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.096807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.097252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:37.149899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:37.159186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9014a3a7-7901-4a22-a184-f130ee9a8b2d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.109921 Jun 17 13:27:37.162455 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2045/3996] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:37 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:37.381657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:37.382868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:37.394634 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.395870 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.397552 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.398592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.560362 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:37.570717 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:37.572970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:37.574860 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-078d66ec-ae93-4418-87ba-228e6f6d0f43 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.200527 Jun 17 13:27:37.577706 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1952/3997] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:37 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:38.178568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:38.179238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:38.189691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.190632 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.199188 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.200231 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.252025 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.253259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.254274 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:38.305241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.313661 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d7f2e0c7-4a5f-468a-b6c4-b79b53559fc4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.139354 Jun 17 13:27:38.314539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2046/3998] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:38 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:38.594042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:38.594701 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:38.602434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.602749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.603299 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.603879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.772038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.781087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.782583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.783792 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7ea19223-1dab-41a1-aa7c-55c72292d075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.193692 Jun 17 13:27:38.784350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1953/3999] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:38 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:39.333415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:39.334168 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:39.341644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.342362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.343534 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.343968 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.361441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:39.390240 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.390688 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.391144 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:39.443424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:39.454073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a7a1e021-1a1e-471f-a5c1-bab722767ae4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.125256 Jun 17 13:27:39.466284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2047/4000] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:39 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:39.804533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:39.806098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:39.813593 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.814376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.815350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.815988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.005952 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.015060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.016683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.018192 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-ec3c1d74-7c2a-49a1-a8f1-6b734eaf3c98 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.218937 Jun 17 13:27:40.019320 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1954/4001] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:39 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:40.475084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:40.476588 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:40.488692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.488692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.488692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.488692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.537682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.538415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.539030 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:40.595725 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.604919 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1ea1e8a7-321d-425c-bf30-ef78bc7e4852 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.135482 Jun 17 13:27:40.614923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2048/4002] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:40 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:41.036296 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:41.036993 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:41.043747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.044512 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.045293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.045729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.238376 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.242478 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:41.248747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.250665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.251868 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-15271640-a8d2-4be5-846a-b9f62f536a5a tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.219533 Jun 17 13:27:41.263927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1955/4003] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:41 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:41.622986 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:41.624558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:41.631754 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.632200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.632994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.633407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.670962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.672179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.672179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:41.714987 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.723304 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bd5aeb1c-b7f1-440f-9341-da388e30191b tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.104937 Jun 17 13:27:41.723944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2049/4004] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:41 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:42.271808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:42.272452 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:42.282164 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.282780 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.283937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.284668 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.460862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.471418 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.472930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.474096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d3859348-d682-4209-a022-b9b4d5400143 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.206518 Jun 17 13:27:42.474656 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1956/4005] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:42 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:42.742071 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:42.742726 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:42.750561 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.751062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.751847 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.752281 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.785430 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.785872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.786340 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:42.830806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.838693 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d11be9bc-177a-45dd-9851-c12b3523bd1d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.100654 Jun 17 13:27:42.839277 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2050/4006] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:42 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:43.492974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:43.493592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:43.500759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.501203 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.501959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.502388 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.644544 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.653297 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.654803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.656001 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f2f65422-8a79-40f0-8cc5-973a545243f6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.167074 Jun 17 13:27:43.656563 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1957/4007] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:43 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:43.862210 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:43.862846 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:43.869841 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.870311 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.871092 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.871555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.907148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.907793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.908256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:43.950352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.957996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-01fd000b-d8d6-4c96-bbed-cea25d6dd987 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.101238 Jun 17 13:27:43.958736 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2051/4008] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:43 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:44.674778 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:44.676286 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:44.683165 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.683678 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.684447 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.684846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.886994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.896801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.898319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.899956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b21ad789-1c5d-4393-ae71-bde40782ddc7 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.229274 Jun 17 13:27:44.900891 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1958/4009] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:44 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:44.975611 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:44.976256 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:44.983912 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.984496 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.985339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.985766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.017888 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.018332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.018777 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lazy-loading 'fault' on Instance uuid 9414346c-91eb-4032-994f-dc957a77a32a {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:27:45.062892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31af58bc06a14e3ba8b709b7deb75341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f9f62d475d4663ae7c211c8adb78e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:45.070514 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6644e5a9-149d-49b7-a463-35bf6d0af7b4 tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 200 len: 1309 microversion: 2.1 time: 0.098813 Jun 17 13:27:45.071100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2052/4010] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:44 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:45.920846 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:45.921464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:45.929679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.930449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.931974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.932737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.086133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.088285 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:46.089159 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] [instance: 9414346c-91eb-4032-994f-dc957a77a32a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:46.095213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.096879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.098090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.098228 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cce2934b-6a7e-483c-9b87-44872bf13866 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.181547 Jun 17 13:27:46.098806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1959/4011] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:45 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:46.098964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.099643 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.100113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.117765 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] HTTP exception thrown: Instance 9414346c-91eb-4032-994f-dc957a77a32a could not be found. Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Request method failure captured: Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a HTTP/1.1 Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHmOR7yh8byvTCiod4w4vJ3sgEJFZZLNS5zVVBORtL8xXpb1q3c-au0oCKKS-SVn0rdJn7baLb-Hb3SjEceXn9isvcf-Vga5oGZ2mYpxST0f3BSUgybdCtBpGute8GsSygK_XWTzDW59i7Ui2snvFlJ8dOeOKq-5tg3XoDBbXHUr0lU Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:27:46.119854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_91f9f62d475d4663ae7c211c8adb78e8", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/91f9f62d475d4663ae7c211c8adb78e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 91f9f62d475d4663ae7c211c8adb78e8 Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2062297124 Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 31af58bc06a14e3ba8b709b7deb75341 Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesSnapshotTestJSON-2062297124-project Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 9414346c-91eb-4032-994f-dc957a77a32a could not be found. Jun 17 13:27:46.121784 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '9414346c-91eb-4032-994f-dc957a77a32a'} Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9414346c-91eb-4032-994f-dc957a77a32a could not be found. Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:27:46.122695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9414346c-91eb-4032-994f-dc957a77a32a could not be found. Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9414346c-91eb-4032-994f-dc957a77a32a could not be found. Jun 17 13:27:46.124814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:27:46.126507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] Returning 404 to user: Instance 9414346c-91eb-4032-994f-dc957a77a32a could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:27:46.126507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-166ddc46-fdae-4b36-974a-f7c11834427d tempest-VolumesSnapshotTestJSON-2062297124 tempest-VolumesSnapshotTestJSON-2062297124-project] 10.222.0.87 "GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a" status: 404 len: 111 microversion: 2.1 time: 0.037154 Jun 17 13:27:46.126507 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2053/4012] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:46 2022] GET /compute/v2.1/servers/9414346c-91eb-4032-994f-dc957a77a32a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:27:47.117558 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:47.119905 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:47.130206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:47.130513 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:47.131274 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:47.131729 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:47.278712 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:47.286960 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:47.288498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:47.289655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-1f8b9165-e23c-40ee-856c-7a1852144755 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.176304 Jun 17 13:27:47.290212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1960/4013] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:47 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:48.313339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:48.314166 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:48.321509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.322309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.323085 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.323541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.471086 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.479525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.481117 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.482337 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-01a92bbd-5d2c-49ac-8f16-5d8f9f37ada3 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.176697 Jun 17 13:27:48.482945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2054/4014] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:48 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:49.501315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:49.501928 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:49.508969 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.509407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:49.510355 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.510811 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:49.644000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:49.653176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:49.654663 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:49.655841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-5f040e39-48b0-4391-8a13-afc8d64842f9 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.158594 Jun 17 13:27:49.656386 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1961/4015] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:49 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:49.987136 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-6e96292a-8fe4-489c-baa1-a7c8f125478e req-f8568d51-d921-4f31-9d49-3bbfc1a6b9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11", "name": "network-vif-plugged", "status": "completed", "tag": "0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:49.996367 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-6e96292a-8fe4-489c-baa1-a7c8f125478e req-f8568d51-d921-4f31-9d49-3bbfc1a6b9c6 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.996828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-6e96292a-8fe4-489c-baa1-a7c8f125478e req-f8568d51-d921-4f31-9d49-3bbfc1a6b9c6 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:50.010248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-6e96292a-8fe4-489c-baa1-a7c8f125478e req-f8568d51-d921-4f31-9d49-3bbfc1a6b9c6 service nova] Creating event network-vif-plugged:0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b for instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 on hv-cinder-84617 Jun 17 13:27:50.015486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-6e96292a-8fe4-489c-baa1-a7c8f125478e req-f8568d51-d921-4f31-9d49-3bbfc1a6b9c6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032517 Jun 17 13:27:50.016079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2055/4016] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:27:50.674457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:50.675727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:50.683621 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:50.684080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:50.684858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:50.685293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:50.832828 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:50.841649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:50.843405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:50.844661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a7620893-1904-4818-84cf-5f0a0dd176d6 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.174415 Jun 17 13:27:50.845305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1962/4017] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:50 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:51.864393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:51.865844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:51.873625 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:51.874073 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:51.874880 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:51.875301 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:52.580373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.589262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.590755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.591910 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e1449778-78d4-48f9-b21b-12be6ae672cf tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1729 microversion: 2.20 time: 0.732413 Jun 17 13:27:52.592467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2056/4018] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:51 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1729 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:53.611769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:53.612420 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:53.620430 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.621157 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.622652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.623342 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.786393 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.797329 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.798975 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.800344 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-25860aec-c4b2-458a-990b-895151e0dcc0 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1716 microversion: 2.20 time: 0.194034 Jun 17 13:27:53.800924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1963/4019] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:53 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1716 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:58.720930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1136068168", "imageRef": "e6df986c-189a-4c4c-ad02-1238faa52eb5", "flavorRef": "452"}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:27:58.726838 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=66 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:58.774157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.network.neutron [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] validate_networks() for None {{(pid=134352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:27:59.054621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Flavor limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:27:59.055046 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Image limits 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:27:59.055567 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Flavor pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:27:59.055980 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Image pref 0:0:0 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:27:59.056394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.virt.hardware [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:27:59.065803 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.066251 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.067047 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.067508 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.090006 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Getting quotas for project 6fe54391d8ee4b8db37c479dd0c66757. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:27:59.094955 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Getting quotas for user 344a774605764d2b8578e64a090f3506 and project 6fe54391d8ee4b8db37c479dd0c66757. Resources: {'instances', 'ram', 'cores'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:27:59.107352 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Going to run 1 instances... {{(pid=134352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:27:59.110010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6df986c-189a-4c4c-ad02-1238faa52eb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:27:59.154001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e92dd1d3-6f77-40f1-b05b-f87e1ec84733 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.436885 Jun 17 13:27:59.154648 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2057/4020] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 13:27:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:27:59.165724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d2107341-8148-447d-923f-65b0567a52a0 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:59.166635 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d2107341-8148-447d-923f-65b0567a52a0 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:59.170345 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:59.225803 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-d2107341-8148-447d-923f-65b0567a52a0 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:59.233549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d2107341-8148-447d-923f-65b0567a52a0 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1215 microversion: 2.1 time: 0.072206 Jun 17 13:27:59.234107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1964/4021] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:59 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:00.250637 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:00.251243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:00.257814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.258239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:00.259036 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.259458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:00.348329 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:00.357175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7af93d4a-0093-419a-bce0-d0a638694cb8 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1275 microversion: 2.1 time: 0.110889 Jun 17 13:28:00.367177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2058/4022] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:00 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:01.375356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:01.376082 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:01.383212 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:01.384019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:01.384457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:01.384880 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:01.515583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:01.523495 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-939342d8-9ee0-4cd8-8d54-41dac450fe6a tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1315 microversion: 2.1 time: 0.152337 Jun 17 13:28:01.524094 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1965/4023] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:01 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:01.864715 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-037324d6-dc2d-475c-b692-24c8fbc755a6 req-dc2e718a-a853-42eb-9a46-559aae151865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a45de5-e95e-4529-97e2-1d547fb098f0", "tag": "36dabc1b-2b5d-45b8-a8ca-7219ae4ed32a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:01.876314 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-037324d6-dc2d-475c-b692-24c8fbc755a6 req-dc2e718a-a853-42eb-9a46-559aae151865 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:01.876964 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-037324d6-dc2d-475c-b692-24c8fbc755a6 req-dc2e718a-a853-42eb-9a46-559aae151865 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:01.894885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-037324d6-dc2d-475c-b692-24c8fbc755a6 req-dc2e718a-a853-42eb-9a46-559aae151865 service nova] Creating event network-changed:36dabc1b-2b5d-45b8-a8ca-7219ae4ed32a for instance 68a45de5-e95e-4529-97e2-1d547fb098f0 on hv-cinder-84617 Jun 17 13:28:01.899895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-037324d6-dc2d-475c-b692-24c8fbc755a6 req-dc2e718a-a853-42eb-9a46-559aae151865 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047171 Jun 17 13:28:01.900679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2059/4024] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:02.483645 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-492a8376-9201-458b-9bb4-729eaaaaeb8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:02.484206 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-492a8376-9201-458b-9bb4-729eaaaaeb8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:02.491124 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-492a8376-9201-458b-9bb4-729eaaaaeb8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.491643 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-492a8376-9201-458b-9bb4-729eaaaaeb8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.492415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-492a8376-9201-458b-9bb4-729eaaaaeb8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.492859 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-492a8376-9201-458b-9bb4-729eaaaaeb8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.519431 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-492a8376-9201-458b-9bb4-729eaaaaeb8b tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/ips" status: 200 len: 145 microversion: 2.1 time: 0.040314 Jun 17 13:28:02.519994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1966/4025] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:28:02 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:02.541156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:02.542157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:02.548993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.549512 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.550333 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.550828 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.685691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:02.697940 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c694174b-4253-4f94-9350-d1c995730529 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1315 microversion: 2.1 time: 0.161082 Jun 17 13:28:02.698627 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2060/4026] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:02 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:03.723303 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:03.723911 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:03.730884 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.731333 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.732204 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.732640 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.860692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-9340de34-0f26-4245-8618-378fb2085bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a694856c-f0c1-4585-880d-3522238c3543"}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:03.862467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-9340de34-0f26-4245-8618-378fb2085bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:03.869265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9340de34-0f26-4245-8618-378fb2085bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.869711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9340de34-0f26-4245-8618-378fb2085bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.870485 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9340de34-0f26-4245-8618-378fb2085bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.870918 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-9340de34-0f26-4245-8618-378fb2085bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.886779 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:03.901021 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f04c5416-fa65-4369-943b-8518dd07fbf1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1315 microversion: 2.1 time: 0.181574 Jun 17 13:28:03.913361 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1967/4027] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:03 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:04.187756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-9340de34-0f26-4245-8618-378fb2085bb1 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331436 Jun 17 13:28:04.188717 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2061/4028] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 13:28:03 2022] POST /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:28:04.918972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:04.919623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:04.926997 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.927475 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:04.928251 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.928683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:05.059356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:05.067384 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-993e5f99-c83c-40d3-9e0b-de65a9813c20 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1315 microversion: 2.1 time: 0.152383 Jun 17 13:28:05.067959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1968/4029] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:04 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:06.059032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-fa54edee-3781-43d4-a338-b23d3d2292b4 req-0f67a3b6-7a87-46b6-9d4a-2200b165c8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a45de5-e95e-4529-97e2-1d547fb098f0", "name": "network-vif-plugged", "status": "completed", "tag": "36dabc1b-2b5d-45b8-a8ca-7219ae4ed32a"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:06.068737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-fa54edee-3781-43d4-a338-b23d3d2292b4 req-0f67a3b6-7a87-46b6-9d4a-2200b165c8bc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.069379 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-fa54edee-3781-43d4-a338-b23d3d2292b4 req-0f67a3b6-7a87-46b6-9d4a-2200b165c8bc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.082871 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-fa54edee-3781-43d4-a338-b23d3d2292b4 req-0f67a3b6-7a87-46b6-9d4a-2200b165c8bc service nova] Creating event network-vif-plugged:36dabc1b-2b5d-45b8-a8ca-7219ae4ed32a for instance 68a45de5-e95e-4529-97e2-1d547fb098f0 on hv-cinder-84617 Jun 17 13:28:06.084705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:06.085515 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:06.088126 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-fa54edee-3781-43d4-a338-b23d3d2292b4 req-0f67a3b6-7a87-46b6-9d4a-2200b165c8bc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033711 Jun 17 13:28:06.089070 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2062/4030] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:06.092974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.093550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.094674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.095091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.238966 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:06.252873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c8cc398a-87b4-4261-9df6-866d7a9d7e86 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1315 microversion: 2.1 time: 0.172241 Jun 17 13:28:06.253464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1969/4031] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:06 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:07.270920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:07.271711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:07.279113 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.279602 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.280376 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.280809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.306711 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-d369540d-f52a-4544-abe4-6423ec71a6e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:07.307332 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-d369540d-f52a-4544-abe4-6423ec71a6e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:07.314262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d369540d-f52a-4544-abe4-6423ec71a6e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.314789 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d369540d-f52a-4544-abe4-6423ec71a6e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.315606 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d369540d-f52a-4544-abe4-6423ec71a6e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.316037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-d369540d-f52a-4544-abe4-6423ec71a6e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.340742 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-d369540d-f52a-4544-abe4-6423ec71a6e9 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/ips" status: 200 len: 149 microversion: 2.1 time: 0.037967 Jun 17 13:28:07.342282 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1970/4032] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:28:07 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:07.425612 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:07.438094 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d2206b75-af9c-45c5-942d-a9ad424ba99d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1315 microversion: 2.1 time: 0.171241 Jun 17 13:28:07.438653 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2063/4033] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:07 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:08.454926 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:08.455586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:08.468564 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.469026 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.469791 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.470389 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.620898 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:08.630468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4692842f-297e-478e-9491-3ac7aadd98a5 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1464 microversion: 2.1 time: 0.179946 Jun 17 13:28:08.631036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1971/4034] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:08 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:08.680695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:08.681641 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:08.691069 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.691857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.693334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.693960 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.698447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:08.704327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b547f002-2502-4981-908d-3a38b1bf65bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fc3bc2d-a82f-4eb8-a466-c9ebccd65a95"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:08.705419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b547f002-2502-4981-908d-3a38b1bf65bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:08.712166 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b547f002-2502-4981-908d-3a38b1bf65bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.712674 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b547f002-2502-4981-908d-3a38b1bf65bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.713477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b547f002-2502-4981-908d-3a38b1bf65bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.713899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b547f002-2502-4981-908d-3a38b1bf65bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.730804 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:28:08.812134 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-04826f26-e216-4608-8a02-7980a1fa6eb6 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "DELETE /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 204 len: 0 microversion: 2.1 time: 0.135679 Jun 17 13:28:08.812851 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2064/4035] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:08 2022] DELETE /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:28:08.821142 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:08.821913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:08.828207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.828752 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.829587 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.830023 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:09.019198 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:09.028961 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-da18d412-05fa-441c-b43f-f08fb3316eb1 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1470 microversion: 2.1 time: 0.211404 Jun 17 13:28:09.029573 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2065/4036] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:08 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:28:09.230024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:10.048373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:10.049024 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:10.051062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:10.051933 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=6 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:10.058312 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.058745 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:10.059574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.060076 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:10.201549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:10.209864 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-14cf5fe8-3da1-47c6-88d3-eae15cfefaee tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1470 microversion: 2.1 time: 0.165444 Jun 17 13:28:10.210452 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2066/4037] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:10 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:10.787337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:10.802487 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b547f002-2502-4981-908d-3a38b1bf65bb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "POST /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.102913 Jun 17 13:28:10.803466 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1972/4038] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 13:28:08 2022] POST /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 194 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:28:11.228776 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:11.229348 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:11.236763 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:11.237233 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:11.238289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:11.238424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:11.383852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:11.392232 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-88514a7c-2b73-4a3b-b638-13b61c926e89 tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1470 microversion: 2.1 time: 0.167804 Jun 17 13:28:11.392788 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2067/4039] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:11 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:28:12.308405 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-29c940e9-9415-488c-af92-6fc0179b8671 req-1ae8c83d-f7da-43f2-8ce4-14d137bef911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a45de5-e95e-4529-97e2-1d547fb098f0", "name": "network-vif-deleted", "tag": "36dabc1b-2b5d-45b8-a8ca-7219ae4ed32a"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:12.325411 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-29c940e9-9415-488c-af92-6fc0179b8671 req-1ae8c83d-f7da-43f2-8ce4-14d137bef911 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.326385 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-29c940e9-9415-488c-af92-6fc0179b8671 req-1ae8c83d-f7da-43f2-8ce4-14d137bef911 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.344879 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-29c940e9-9415-488c-af92-6fc0179b8671 req-1ae8c83d-f7da-43f2-8ce4-14d137bef911 service nova] Creating event network-vif-deleted:36dabc1b-2b5d-45b8-a8ca-7219ae4ed32a for instance 68a45de5-e95e-4529-97e2-1d547fb098f0 on hv-cinder-84617 Jun 17 13:28:12.350168 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-29c940e9-9415-488c-af92-6fc0179b8671 req-1ae8c83d-f7da-43f2-8ce4-14d137bef911 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047983 Jun 17 13:28:12.351152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1973/4040] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:12.410617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:12.411235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:12.419503 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.419854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.420894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.421326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.457424 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.458437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.458658 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lazy-loading 'fault' on Instance uuid 68a45de5-e95e-4529-97e2-1d547fb098f0 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:28:12.502411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:12.510148 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d8b5115a-1136-4ba8-ba27-0cfb05109eba tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1305 microversion: 2.1 time: 0.103620 Jun 17 13:28:12.510728 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2068/4041] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:12 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:12.779528 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f1220c2b-2004-42af-b396-497fb359ba01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:12.780533 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f1220c2b-2004-42af-b396-497fb359ba01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:12.787477 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1220c2b-2004-42af-b396-497fb359ba01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.787917 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1220c2b-2004-42af-b396-497fb359ba01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.788661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1220c2b-2004-42af-b396-497fb359ba01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.789079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1220c2b-2004-42af-b396-497fb359ba01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.819087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f1220c2b-2004-42af-b396-497fb359ba01 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Jun 17 13:28:12.819680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1974/4042] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:12 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:12.830032 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-496e77c5-15c8-4527-bb9c-9b8d2b157519 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:12.830800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-496e77c5-15c8-4527-bb9c-9b8d2b157519 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:12.837007 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-496e77c5-15c8-4527-bb9c-9b8d2b157519 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.837475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-496e77c5-15c8-4527-bb9c-9b8d2b157519 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.838217 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-496e77c5-15c8-4527-bb9c-9b8d2b157519 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.838640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-496e77c5-15c8-4527-bb9c-9b8d2b157519 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.867950 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-496e77c5-15c8-4527-bb9c-9b8d2b157519 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/a694856c-f0c1-4585-880d-3522238c3543" status: 200 len: 194 microversion: 2.1 time: 0.042179 Jun 17 13:28:12.868712 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2069/4043] 10.222.0.87 () {58 vars in 1412 bytes} [Fri Jun 17 13:28:12 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/a694856c-f0c1-4585-880d-3522238c3543 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:13.527685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:13.528360 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:13.535702 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.536144 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.536964 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.537327 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.569439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.569873 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.570315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lazy-loading 'fault' on Instance uuid 68a45de5-e95e-4529-97e2-1d547fb098f0 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:28:13.616415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344a774605764d2b8578e64a090f3506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe54391d8ee4b8db37c479dd0c66757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:13.624553 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6a79e3d2-03a2-4a4a-96d1-f8c31853651d tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 200 len: 1305 microversion: 2.1 time: 0.100844 Jun 17 13:28:13.625107 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1975/4044] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:13 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:14.642296 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:14.642903 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] [instance: 68a45de5-e95e-4529-97e2-1d547fb098f0] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:14.649750 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.650164 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:14.650941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.651361 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:14.665930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] HTTP exception thrown: Instance 68a45de5-e95e-4529-97e2-1d547fb098f0 could not be found. Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Request method failure captured: Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 HTTP/1.1 Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirIFd-yIHrxuHe2klv1uYkeURS8T1ljjq2JtDWpi7SIkNbbNZT_8HGxxLTqg-lEib8zFEY6bgq1wZ64HpwAS8gCSxk5sHIIZG-2qQVEiikFZA3-BynjLq_8g-HW8dfehj1vp67nkBfojpMteBUpQd60kxa3tPxSV-GMbKXLbEBatDJGA Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: 6fe54391d8ee4b8db37c479dd0c66757 Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesNegativeTest-2062844802 Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:14.667635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6fe54391d8ee4b8db37c479dd0c66757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6fe54391d8ee4b8db37c479dd0c66757"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6fe54391d8ee4b8db37c479dd0c66757", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6fe54391d8ee4b8db37c479dd0c66757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesNegativeTest-2062844802 Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: 6fe54391d8ee4b8db37c479dd0c66757 Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesNegativeTest-2062844802 Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesNegativeTest-2062844802-project Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 344a774605764d2b8578e64a090f3506 Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesNegativeTest-2062844802-project Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 68a45de5-e95e-4529-97e2-1d547fb098f0 could not be found. Jun 17 13:28:14.669810 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '68a45de5-e95e-4529-97e2-1d547fb098f0'} Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a45de5-e95e-4529-97e2-1d547fb098f0 could not be found. Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:14.671100 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a45de5-e95e-4529-97e2-1d547fb098f0 could not be found. Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a45de5-e95e-4529-97e2-1d547fb098f0 could not be found. Jun 17 13:28:14.672872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:14.674313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] Returning 404 to user: Instance 68a45de5-e95e-4529-97e2-1d547fb098f0 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:14.674313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-3bb7ed42-9caf-4607-bfb0-cb1107ab156c tempest-VolumesNegativeTest-2062844802 tempest-VolumesNegativeTest-2062844802-project] 10.222.0.87 "GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0" status: 404 len: 111 microversion: 2.1 time: 0.030947 Jun 17 13:28:14.674313 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2070/4045] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:14 2022] GET /compute/v2.1/servers/68a45de5-e95e-4529-97e2-1d547fb098f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:15.265704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-690fcc43-f806-4e3e-8419-d57fd70462c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0521565f-98d2-47fb-a668-6203a1be3212"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:15.266783 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-690fcc43-f806-4e3e-8419-d57fd70462c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:15.273627 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-690fcc43-f806-4e3e-8419-d57fd70462c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:15.274061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-690fcc43-f806-4e3e-8419-d57fd70462c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:15.274830 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-690fcc43-f806-4e3e-8419-d57fd70462c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:15.275285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-690fcc43-f806-4e3e-8419-d57fd70462c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:15.690270 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-690fcc43-f806-4e3e-8419-d57fd70462c9 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "POST /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428503 Jun 17 13:28:15.691244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1976/4046] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 13:28:15 2022] POST /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:19.501697 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:19.502419 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:19.510443 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.511020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.511937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.512480 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.602730 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lazy-loading 'services' on Instance uuid b5737522-b371-4d73-ae95-47ecf041eecc {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:28:19.674991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-647410d2-577d-4bef-b67c-2f0de94a82b1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments/7fc3bc2d-a82f-4eb8-a466-c9ebccd65a95" status: 202 len: 0 microversion: 2.1 time: 0.177357 Jun 17 13:28:19.675705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2071/4047] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:28:19 2022] DELETE /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments/7fc3bc2d-a82f-4eb8-a466-c9ebccd65a95 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:19.686191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4237e9f3-8220-427b-af39-ac908b09c0ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:19.687254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4237e9f3-8220-427b-af39-ac908b09c0ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:19.694037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4237e9f3-8220-427b-af39-ac908b09c0ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.694549 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4237e9f3-8220-427b-af39-ac908b09c0ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.695242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4237e9f3-8220-427b-af39-ac908b09c0ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.695769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4237e9f3-8220-427b-af39-ac908b09c0ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.728067 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4237e9f3-8220-427b-af39-ac908b09c0ee tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Jun 17 13:28:19.728628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1977/4048] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:19 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:20.742393 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7cd412ac-7de3-4ca0-9607-62b0e2e969ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:20.743460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7cd412ac-7de3-4ca0-9607-62b0e2e969ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:20.750565 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd412ac-7de3-4ca0-9607-62b0e2e969ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.750995 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd412ac-7de3-4ca0-9607-62b0e2e969ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:20.751778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd412ac-7de3-4ca0-9607-62b0e2e969ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.752204 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7cd412ac-7de3-4ca0-9607-62b0e2e969ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:20.782792 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7cd412ac-7de3-4ca0-9607-62b0e2e969ae tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045395 Jun 17 13:28:20.783332 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2072/4049] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:20 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:21.797072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62e238f0-c080-4096-863f-8ffd5da87bbb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:21.798005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62e238f0-c080-4096-863f-8ffd5da87bbb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:21.804994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e238f0-c080-4096-863f-8ffd5da87bbb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:21.805440 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e238f0-c080-4096-863f-8ffd5da87bbb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:21.806208 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e238f0-c080-4096-863f-8ffd5da87bbb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:21.806642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62e238f0-c080-4096-863f-8ffd5da87bbb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:21.838070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62e238f0-c080-4096-863f-8ffd5da87bbb tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Jun 17 13:28:21.838637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1978/4050] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:21 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:22.850385 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-12654048-d358-47b2-96dc-b7c7a711969e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:22.851357 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-12654048-d358-47b2-96dc-b7c7a711969e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:22.858872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12654048-d358-47b2-96dc-b7c7a711969e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.859342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12654048-d358-47b2-96dc-b7c7a711969e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.860137 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12654048-d358-47b2-96dc-b7c7a711969e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.860568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-12654048-d358-47b2-96dc-b7c7a711969e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.891197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-12654048-d358-47b2-96dc-b7c7a711969e tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Jun 17 13:28:22.891809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2073/4051] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:22 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:23.903311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-300c98ae-0094-4464-803a-604e2193c633 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:23.904569 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-300c98ae-0094-4464-803a-604e2193c633 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:23.911573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-300c98ae-0094-4464-803a-604e2193c633 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.912028 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-300c98ae-0094-4464-803a-604e2193c633 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.912790 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-300c98ae-0094-4464-803a-604e2193c633 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.913221 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-300c98ae-0094-4464-803a-604e2193c633 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.943664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-300c98ae-0094-4464-803a-604e2193c633 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Jun 17 13:28:23.944223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1979/4052] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:23 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:24.956463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0b6a197d-c69d-4736-91cf-7a58a62ada6c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:24.957363 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0b6a197d-c69d-4736-91cf-7a58a62ada6c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:24.964822 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b6a197d-c69d-4736-91cf-7a58a62ada6c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.965278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b6a197d-c69d-4736-91cf-7a58a62ada6c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.966265 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b6a197d-c69d-4736-91cf-7a58a62ada6c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.966705 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0b6a197d-c69d-4736-91cf-7a58a62ada6c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.997439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0b6a197d-c69d-4736-91cf-7a58a62ada6c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Jun 17 13:28:24.998001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2074/4053] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:24 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:25.336180 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7c572b2b-0e08-46c7-9704-1a35ba514e75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:25.337112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7c572b2b-0e08-46c7-9704-1a35ba514e75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:25.346293 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c572b2b-0e08-46c7-9704-1a35ba514e75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.346739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c572b2b-0e08-46c7-9704-1a35ba514e75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.347763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c572b2b-0e08-46c7-9704-1a35ba514e75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.348191 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7c572b2b-0e08-46c7-9704-1a35ba514e75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.380370 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7c572b2b-0e08-46c7-9704-1a35ba514e75 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048072 Jun 17 13:28:25.381005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1980/4054] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:25 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:25.483773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-696fb724-c1b6-4099-8064-e79473a162eb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:25.484289 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-696fb724-c1b6-4099-8064-e79473a162eb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:25.490861 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696fb724-c1b6-4099-8064-e79473a162eb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.491309 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696fb724-c1b6-4099-8064-e79473a162eb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.492106 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696fb724-c1b6-4099-8064-e79473a162eb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.492539 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-696fb724-c1b6-4099-8064-e79473a162eb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.524193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-696fb724-c1b6-4099-8064-e79473a162eb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/a694856c-f0c1-4585-880d-3522238c3543" status: 200 len: 194 microversion: 2.1 time: 0.045241 Jun 17 13:28:25.525607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2075/4055] 10.222.0.87 () {58 vars in 1412 bytes} [Fri Jun 17 13:28:25 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/a694856c-f0c1-4585-880d-3522238c3543 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:25.536972 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:25.537471 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:25.544075 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.544545 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.545669 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.546374 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.633030 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lazy-loading 'services' on Instance uuid ea25a26b-5528-4263-b959-666f40e187ac {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:28:25.716824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2516603f-d5e8-471d-8938-2cb684e7d1ed tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/a694856c-f0c1-4585-880d-3522238c3543" status: 202 len: 0 microversion: 2.1 time: 0.184327 Jun 17 13:28:25.717521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1981/4056] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:28:25 2022] DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/a694856c-f0c1-4585-880d-3522238c3543 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:26.010040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ef79f384-489e-4784-8f4a-621a93001303 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:26.010887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ef79f384-489e-4784-8f4a-621a93001303 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:26.018103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef79f384-489e-4784-8f4a-621a93001303 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.018544 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef79f384-489e-4784-8f4a-621a93001303 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.019295 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef79f384-489e-4784-8f4a-621a93001303 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.019759 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ef79f384-489e-4784-8f4a-621a93001303 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.048796 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ef79f384-489e-4784-8f4a-621a93001303 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042859 Jun 17 13:28:26.049356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2076/4057] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:26 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:28:26.112642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:26.113222 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:26.120079 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.120498 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.121290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.121692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.149061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:28:26.224201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-03f44aed-37bf-4502-839b-f817aac91624 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 204 len: 0 microversion: 2.1 time: 0.116143 Jun 17 13:28:26.224797 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1982/4058] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:26 2022] DELETE /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:28:26.234817 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:26.235635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:26.241899 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.242353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.243145 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.243607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.374213 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:26.382237 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e5d44b77-a0f0-4651-a02a-23306feb8eb7 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1680 microversion: 2.1 time: 0.152975 Jun 17 13:28:26.382813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2077/4059] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:26 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:27.400720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:27.401736 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:27.409568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:27.410003 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:27.410759 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:27.411185 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:27.551128 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:27.559223 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2efa9c11-edab-49e7-b4d3-5a1a3d3c0950 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1680 microversion: 2.1 time: 0.163067 Jun 17 13:28:27.559863 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1983/4060] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:27 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:28.577053 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:28.577647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:28.585778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.586351 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.587324 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.587825 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.830917 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:28.833390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:28.840234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-711f36ca-7cdd-47f3-99f7-e91e2c8e576b tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1680 microversion: 2.1 time: 0.267067 Jun 17 13:28:28.840760 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2078/4061] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:28 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1680 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:28.958688 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-130bd5e6-affd-419c-9f68-574f092eb9ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:28.959317 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-130bd5e6-affd-419c-9f68-574f092eb9ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:28.968394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-130bd5e6-affd-419c-9f68-574f092eb9ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.969265 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-130bd5e6-affd-419c-9f68-574f092eb9ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.969546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-130bd5e6-affd-419c-9f68-574f092eb9ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.969990 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-130bd5e6-affd-419c-9f68-574f092eb9ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.008449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-130bd5e6-affd-419c-9f68-574f092eb9ce tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/0521565f-98d2-47fb-a668-6203a1be3212" status: 200 len: 194 microversion: 2.1 time: 0.053806 Jun 17 13:28:29.009088 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1984/4062] 10.222.0.87 () {58 vars in 1412 bytes} [Fri Jun 17 13:28:28 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/0521565f-98d2-47fb-a668-6203a1be3212 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:29.020405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:29.020930 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:29.023062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:29.029878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.030328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.031288 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.031761 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.133013 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lazy-loading 'services' on Instance uuid ea25a26b-5528-4263-b959-666f40e187ac {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:28:29.218740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7a5c2dbe-44db-4578-a595-fe9b659b063a tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/0521565f-98d2-47fb-a668-6203a1be3212" status: 202 len: 0 microversion: 2.1 time: 0.203033 Jun 17 13:28:29.219441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2079/4063] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:28:29 2022] DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments/0521565f-98d2-47fb-a668-6203a1be3212 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:29.583248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-c4921165-bbbf-4a90-abf3-dab3fc095c43 req-ec08c201-b2c7-4152-8101-0ccf9cba4215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5737522-b371-4d73-ae95-47ecf041eecc", "name": "network-vif-deleted", "tag": "34e7bb02-1f29-4b3d-a984-e96569c0754a"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:29.586665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:29.594787 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c4921165-bbbf-4a90-abf3-dab3fc095c43 req-ec08c201-b2c7-4152-8101-0ccf9cba4215 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.595245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c4921165-bbbf-4a90-abf3-dab3fc095c43 req-ec08c201-b2c7-4152-8101-0ccf9cba4215 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.611304 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-c4921165-bbbf-4a90-abf3-dab3fc095c43 req-ec08c201-b2c7-4152-8101-0ccf9cba4215 service nova] Creating event network-vif-deleted:34e7bb02-1f29-4b3d-a984-e96569c0754a for instance b5737522-b371-4d73-ae95-47ecf041eecc on hv-cinder-84617 Jun 17 13:28:29.617858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-c4921165-bbbf-4a90-abf3-dab3fc095c43 req-ec08c201-b2c7-4152-8101-0ccf9cba4215 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038799 Jun 17 13:28:29.618744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1985/4064] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:29.860040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:29.860742 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:29.867906 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.868375 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.869147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.869580 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.906938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.907466 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.907944 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lazy-loading 'fault' on Instance uuid b5737522-b371-4d73-ae95-47ecf041eecc {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:28:29.967582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9863e406790b413faf022554ba4b8dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1bbb589db14084aff24be5d6e118a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:29.975449 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c55256aa-0d89-4239-8e71-f908a60d59ef tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 200 len: 1330 microversion: 2.1 time: 0.120540 Jun 17 13:28:29.976042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2080/4065] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:29 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:30.402705 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-85c2b9f0-7a44-4660-8334-86ff4a93f5e4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.404675 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-85c2b9f0-7a44-4660-8334-86ff4a93f5e4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:30.411273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85c2b9f0-7a44-4660-8334-86ff4a93f5e4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.411782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85c2b9f0-7a44-4660-8334-86ff4a93f5e4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.412580 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85c2b9f0-7a44-4660-8334-86ff4a93f5e4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.413035 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-85c2b9f0-7a44-4660-8334-86ff4a93f5e4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.440520 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:30.445572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-85c2b9f0-7a44-4660-8334-86ff4a93f5e4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047583 Jun 17 13:28:30.446153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1986/4066] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:30 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:28:30.560284 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b043c60b-7c84-4777-8e4b-8551912631f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.562566 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b043c60b-7c84-4777-8e4b-8551912631f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:30.569011 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b043c60b-7c84-4777-8e4b-8551912631f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.569766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b043c60b-7c84-4777-8e4b-8551912631f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.570215 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b043c60b-7c84-4777-8e4b-8551912631f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.570646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b043c60b-7c84-4777-8e4b-8551912631f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.601778 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b043c60b-7c84-4777-8e4b-8551912631f4 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045422 Jun 17 13:28:30.602354 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2081/4067] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:28:30 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:28:30.671009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.671009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:30.679269 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.679716 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.680649 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.681259 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.708038 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:28:30.793809 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-84635628-88a4-4713-a766-6c7383aae5f6 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 204 len: 0 microversion: 2.1 time: 0.126951 Jun 17 13:28:30.795098 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1987/4068] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:30 2022] DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:28:30.804208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.804985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:30.813282 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.813635 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.814406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.814855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.951996 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:30.960262 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-556f35e4-6dcd-43c2-8f6a-91deef319099 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1672 microversion: 2.1 time: 0.160380 Jun 17 13:28:30.960834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2082/4069] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:30 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:30.994277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.995042 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:31.001939 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.002373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:31.003147 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.003609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:31.018016 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc HTTP/1.1 Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:31.019756 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:31.021565 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'b5737522-b371-4d73-ae95-47ecf041eecc'} Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:31.022598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:31.024319 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:31.025956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:31.025956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4ebe9780-324a-4b55-ad36-5d5bb8a84c18 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 404 len: 111 microversion: 2.1 time: 0.031259 Jun 17 13:28:31.025956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1988/4070] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:30 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:31.030764 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b90deaaf-7ea4-4538-9811-0b4ffe13c1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '.version_select at 0x7f45530bddc0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:31.051242 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b90deaaf-7ea4-4538-9811-0b4ffe13c1b8 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594288377" status: 202 len: 0 microversion: 2.1 time: 0.024538 Jun 17 13:28:31.051863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2083/4071] 10.222.0.87 () {58 vars in 1217 bytes} [Fri Jun 17 13:28:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594288377 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:31.979330 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:31.980160 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:31.988773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.990132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:31.990132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.991752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.142623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:32.150664 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a411cdd1-e0cf-4150-8907-32baf4a29aaa tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1672 microversion: 2.1 time: 0.175348 Jun 17 13:28:32.151213 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1989/4072] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:31 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:32.848098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:32.848704 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:32.854994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.855439 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.856229 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.856886 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.871737 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc HTTP/1.1 Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:32.874000 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.875758 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'b5737522-b371-4d73-ae95-47ecf041eecc'} Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:32.876727 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.878365 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.880084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:32.880084 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e225b086-8fde-4b66-b65f-1e77a1a3ea4a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 404 len: 111 microversion: 2.1 time: 0.031854 Jun 17 13:28:32.881836 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2084/4073] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:32 2022] DELETE /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:32.884037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:32.884651 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: b5737522-b371-4d73-ae95-47ecf041eecc] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:32.890771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.891216 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.892004 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.892444 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.908254 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc HTTP/1.1 Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:32.909801 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.911582 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'b5737522-b371-4d73-ae95-47ecf041eecc'} Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:32.912973 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. Jun 17 13:28:32.914439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.916724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance b5737522-b371-4d73-ae95-47ecf041eecc could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:32.916724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b18963e7-e000-4aa9-b6a6-2a79be3551e1 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc" status: 404 len: 111 microversion: 2.1 time: 0.031025 Jun 17 13:28:32.916724 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1990/4074] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:32 2022] GET /compute/v2.1/servers/b5737522-b371-4d73-ae95-47ecf041eecc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:32.919945 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:32.920469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:32.927328 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.927894 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.928766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.929269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.943716 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c HTTP/1.1 Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:32.945471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.947325 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '4d4faf5d-3bec-46ab-8038-57b814a30b3c'} Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:32.948569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.950542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.953088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:32.953088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0a358f8f-ab87-447a-ae06-2301951f7a36 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 404 len: 111 microversion: 2.1 time: 0.030895 Jun 17 13:28:32.953088 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2085/4075] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:32 2022] DELETE /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:28:32.955680 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:32.956455 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 4d4faf5d-3bec-46ab-8038-57b814a30b3c] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:32.962550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.962994 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.963826 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.964261 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.978238 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c HTTP/1.1 Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:32.979851 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.982194 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '4d4faf5d-3bec-46ab-8038-57b814a30b3c'} Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:32.983691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. Jun 17 13:28:32.985375 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:32.987061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 4d4faf5d-3bec-46ab-8038-57b814a30b3c could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:32.987061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-62159bf2-beb9-494b-8f44-0244e9529e84 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c" status: 404 len: 111 microversion: 2.1 time: 0.029542 Jun 17 13:28:32.987061 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1991/4076] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:32 2022] GET /compute/v2.1/servers/4d4faf5d-3bec-46ab-8038-57b814a30b3c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:32.990603 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:32.991098 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:32.997902 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.998353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.999115 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.999582 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.013667 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 HTTP/1.1 Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:33.015297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.017162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '20dafd2a-15d7-4ada-b421-c051e3998e05'} Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:33.018193 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.019954 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.021644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:33.021644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1fe8bc3f-4bbe-44e8-85d1-6a0b7cc297fc tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 404 len: 111 microversion: 2.1 time: 0.030023 Jun 17 13:28:33.021644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2086/4077] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:32 2022] DELETE /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:28:33.025298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:33.025915 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 20dafd2a-15d7-4ada-b421-c051e3998e05] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:33.033182 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.033628 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.034404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.034832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.048739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 HTTP/1.1 Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:33.050290 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.052169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '20dafd2a-15d7-4ada-b421-c051e3998e05'} Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:33.053176 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. Jun 17 13:28:33.054882 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:33.056449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 20dafd2a-15d7-4ada-b421-c051e3998e05 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:33.056449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-078dff2e-4ee6-4052-9e5d-a31fbf33496a tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05" status: 404 len: 111 microversion: 2.1 time: 0.030240 Jun 17 13:28:33.056449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1992/4078] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:33 2022] GET /compute/v2.1/servers/20dafd2a-15d7-4ada-b421-c051e3998e05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:33.172684 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:33.173308 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:33.179657 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.180105 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.180878 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.181306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.399621 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bfb04b34ed4761bb09be7b29d1ec8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead9b99d062e49a88a88e8b37a3b3519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:33.409465 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-aea1bf78-59c6-49f6-a04e-365e5c38814c tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 200 len: 1672 microversion: 2.1 time: 0.243721 Jun 17 13:28:33.410054 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2087/4079] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:33 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:33.720425 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-b760a2ee-d13a-4a82-81e8-ee8108948f45 req-dc377083-113a-4f78-97d1-488288796952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea25a26b-5528-4263-b959-666f40e187ac", "name": "network-vif-deleted", "tag": "f3a69d0d-98d4-490c-acb7-38f8368c1bd0"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:33.729741 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b760a2ee-d13a-4a82-81e8-ee8108948f45 req-dc377083-113a-4f78-97d1-488288796952 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.730153 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-b760a2ee-d13a-4a82-81e8-ee8108948f45 req-dc377083-113a-4f78-97d1-488288796952 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.760234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-b760a2ee-d13a-4a82-81e8-ee8108948f45 req-dc377083-113a-4f78-97d1-488288796952 service nova] Creating event network-vif-deleted:f3a69d0d-98d4-490c-acb7-38f8368c1bd0 for instance ea25a26b-5528-4263-b959-666f40e187ac on hv-cinder-84617 Jun 17 13:28:33.767029 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-b760a2ee-d13a-4a82-81e8-ee8108948f45 req-dc377083-113a-4f78-97d1-488288796952 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050242 Jun 17 13:28:33.768696 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1993/4080] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:34.214278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.215129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.226722 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.227175 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.227977 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.228411 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.246279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 HTTP/1.1 Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:34.248770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.250674 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '00ab137b-ba6b-4ea1-96d9-2cad4c99cc75'} Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:34.251942 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.253549 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.255241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:34.255241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-543515b8-0649-4d98-84bf-8e36f0e11436 tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "DELETE /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 404 len: 111 microversion: 2.1 time: 0.042725 Jun 17 13:28:34.255241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2088/4081] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:34 2022] DELETE /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:34.277521 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.280199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] [instance: 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.299464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.300005 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.302903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.303458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.328373 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] HTTP exception thrown: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Request method failure captured: Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 HTTP/1.1 Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjbXIVfikZOYchSr4U8Qnf5VoHVQCTsdibuyhJm28WvdTJ14CLCfTD37crivKzt_y8FRYjGd2a6qH4irHJ8NiNmjPNJ7-xK3yNtFXQ5SRepLHoDC7FIUNpDPI_4KZ7rX0oy8M4LOATINvd3je6j-uAhFzAY4IaeySo-Odxi8NNusMo Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:34.343981 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ea1bbb589db14084aff24be5d6e118a3", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ea1bbb589db14084aff24be5d6e118a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ea1bbb589db14084aff24be5d6e118a3 Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-122814282 Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 9863e406790b413faf022554ba4b8dfe Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeNegativeTest-122814282-project Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.346534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '00ab137b-ba6b-4ea1-96d9-2cad4c99cc75'} Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:34.347892 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. Jun 17 13:28:34.350922 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.360428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] Returning 404 to user: Instance 00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:34.360428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0a0f13d1-3b17-4009-9653-66620282ae9c tempest-AttachVolumeNegativeTest-122814282 tempest-AttachVolumeNegativeTest-122814282-project] 10.222.0.87 "GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75" status: 404 len: 111 microversion: 2.1 time: 0.079434 Jun 17 13:28:34.360428 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1994/4082] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:34 2022] GET /compute/v2.1/servers/00ab137b-ba6b-4ea1-96d9-2cad4c99cc75 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:34.362934 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8f433041-c859-44f4-8d3d-ac81f04b8571 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.363905 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8f433041-c859-44f4-8d3d-ac81f04b8571 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.371405 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f433041-c859-44f4-8d3d-ac81f04b8571 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.371834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f433041-c859-44f4-8d3d-ac81f04b8571 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.372640 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f433041-c859-44f4-8d3d-ac81f04b8571 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.373067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8f433041-c859-44f4-8d3d-ac81f04b8571 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.408835 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8f433041-c859-44f4-8d3d-ac81f04b8571 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051995 Jun 17 13:28:34.410156 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2089/4083] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Jun 17 13:28:34 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:28:34.427097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.428138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.434747 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.435967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.437169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.438242 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] HTTP exception thrown: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Request method failure captured: Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac HTTP/1.1 Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjlH4qw7eZHdMiPVaIeNbWwEME0d5X7w0zJ2BIAPVTHOm4uBpKYteGHJQgCMXBhuDNNDBn3yFqubMXH7Y9D0HHg_nm9DJiTriCt-Q0gI3MYrZSxVl91N23DkagPjfMUCJ8DpVW5qxuKPcQJX5iqp4ajiR9YzU_866TsArhC_Mv3nmQ Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:34.459349 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ead9b99d062e49a88a88e8b37a3b3519", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: f3bfb04b34ed4761bb09be7b29d1ec8f Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:34.464493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'ea25a26b-5528-4263-b959-666f40e187ac'} Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:34.465527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:34.467514 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:34.469036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Returning 404 to user: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:34.469036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-725477ec-9f4a-41e4-a4dd-44a1bc9ac0fd tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 404 len: 111 microversion: 2.1 time: 0.037394 Jun 17 13:28:34.469036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1995/4084] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:34 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:34.475793 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-39e3e797-0af6-4d62-9500-43f9c12f64cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '.version_select at 0x7f454e88c820>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.493843 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.494799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.505055 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-39e3e797-0af6-4d62-9500-43f9c12f64cb tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262805253" status: 202 len: 0 microversion: 2.1 time: 0.033914 Jun 17 13:28:34.506044 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.506752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.507633 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2090/4085] 10.222.0.87 () {58 vars in 1217 bytes} [Fri Jun 17 13:28:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262805253 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:34.511698 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.512205 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.550748 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Going to try to terminate instance {{(pid=134351) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:28:34.657340 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f5618e92-e46f-4427-ad8b-e93ec17f164d tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 204 len: 0 microversion: 2.20 time: 0.170045 Jun 17 13:28:34.658262 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1996/4086] 10.222.0.87 () {60 vars in 1279 bytes} [Fri Jun 17 13:28:34 2022] DELETE /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 17 13:28:34.667552 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.668179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.674660 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.675127 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.675913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.676350 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.934852 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.940814 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.942297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.943511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5ca169d1-796e-4edc-8075-e93a83a445d1 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.280308 Jun 17 13:28:34.951486 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2091/4087] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:34 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:35.970872 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:35.971469 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:35.978632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.979085 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:35.979886 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.980300 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:36.117782 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:36.126955 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:36.128504 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:36.129825 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-bd739887-3b2c-43d1-ba0a-87befcdee075 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1722 microversion: 2.20 time: 0.163876 Jun 17 13:28:36.130592 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1997/4088] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:35 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:37.148516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:37.149122 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:37.156205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.156920 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.158037 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.158468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.261433 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.275406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.277096 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14c1230233e43789087e9239ffb91e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3495f3daaa44dc9b20a08f3e1128bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.278811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-849f530e-6a16-4140-b937-01e851bcbd50 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 200 len: 1655 microversion: 2.20 time: 0.134288 Jun 17 13:28:37.289753 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2092/4089] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:37 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:37.391949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-6ca8a8c0-56cf-4179-af8c-46b02c52a00a req-074535d0-8f5a-47d3-85a6-465f3834ea34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11", "name": "network-vif-deleted", "tag": "0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:37.415326 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-6ca8a8c0-56cf-4179-af8c-46b02c52a00a req-074535d0-8f5a-47d3-85a6-465f3834ea34 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.416661 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-6ca8a8c0-56cf-4179-af8c-46b02c52a00a req-074535d0-8f5a-47d3-85a6-465f3834ea34 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.433526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-6ca8a8c0-56cf-4179-af8c-46b02c52a00a req-074535d0-8f5a-47d3-85a6-465f3834ea34 service nova] Creating event network-vif-deleted:0031640e-c8f1-43d8-8d9c-dfdeb6b8b95b for instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 on hv-cinder-84617 Jun 17 13:28:37.439812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-6ca8a8c0-56cf-4179-af8c-46b02c52a00a req-074535d0-8f5a-47d3-85a6-465f3834ea34 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057289 Jun 17 13:28:37.445958 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1998/4090] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:37.709749 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:37.710598 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:37.718048 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.718812 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.719797 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.720390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.740010 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] HTTP exception thrown: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Request method failure captured: Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac HTTP/1.1 Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjlH4qw7eZHdMiPVaIeNbWwEME0d5X7w0zJ2BIAPVTHOm4uBpKYteGHJQgCMXBhuDNNDBn3yFqubMXH7Y9D0HHg_nm9DJiTriCt-Q0gI3MYrZSxVl91N23DkagPjfMUCJ8DpVW5qxuKPcQJX5iqp4ajiR9YzU_866TsArhC_Mv3nmQ Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:37.748197 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ead9b99d062e49a88a88e8b37a3b3519", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: f3bfb04b34ed4761bb09be7b29d1ec8f Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.750097 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'ea25a26b-5528-4263-b959-666f40e187ac'} Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:37.751074 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.752607 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.755887 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Returning 404 to user: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:37.763904 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7979a384-7fff-4c98-897d-1ffdf37e4642 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 404 len: 111 microversion: 2.1 time: 0.051786 Jun 17 13:28:37.768536 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2093/4091] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:37 2022] DELETE /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:37.775764 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:37.776934 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: ea25a26b-5528-4263-b959-666f40e187ac] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:37.784560 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.785532 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.804175 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.804727 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.839134 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] HTTP exception thrown: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Request method failure captured: Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac HTTP/1.1 Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjlH4qw7eZHdMiPVaIeNbWwEME0d5X7w0zJ2BIAPVTHOm4uBpKYteGHJQgCMXBhuDNNDBn3yFqubMXH7Y9D0HHg_nm9DJiTriCt-Q0gI3MYrZSxVl91N23DkagPjfMUCJ8DpVW5qxuKPcQJX5iqp4ajiR9YzU_866TsArhC_Mv3nmQ Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:37.840605 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ead9b99d062e49a88a88e8b37a3b3519", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: f3bfb04b34ed4761bb09be7b29d1ec8f Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.843919 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'ea25a26b-5528-4263-b959-666f40e187ac'} Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:37.845737 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. Jun 17 13:28:37.849458 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:37.858234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Returning 404 to user: Instance ea25a26b-5528-4263-b959-666f40e187ac could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:37.858234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-b86420d6-d7d0-413b-8052-8d2fe86644a2 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac" status: 404 len: 111 microversion: 2.1 time: 0.071818 Jun 17 13:28:37.858234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 1999/4092] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:37 2022] GET /compute/v2.1/servers/ea25a26b-5528-4263-b959-666f40e187ac => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:38.298347 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:38.299844 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:38.309428 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.309993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:38.311020 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.311551 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:38.326297 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] HTTP exception thrown: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Request method failure captured: Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 HTTP/1.1 Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjf05qfOUfDNMRubGomHkEtoIw9Y7JHEzMJ54J8Nn9vHn1m1fcsPg6avq1WLjYI_y_-rhFj5xUyUicO-gG6fZqsX-TZ6VXYdQow_e-kM4-8pBUBBnyxgLxMEudwra4nh2D1EhmGuC6lEBIJ8EsjSYCwgFYUhKhnPt7eDwRVKEoEmyo Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:38.328157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b3495f3daaa44dc9b20a08f3e1128bfa", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: a14c1230233e43789087e9239ffb91e2 Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:38.330075 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11'} Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:38.331057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:38.332857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:38.334390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Returning 404 to user: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:38.334390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-6e44bd6c-2ee9-46c9-aa27-b3a5553163fe tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 404 len: 111 microversion: 2.20 time: 0.036872 Jun 17 13:28:38.334390 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2094/4093] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:38 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:28:38.340244 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0564c6db-27a6-4dc8-a134-a59e3f139cc2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '.version_select at 0x7f454ea68820>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:38.362848 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0564c6db-27a6-4dc8-a134-a59e3f139cc2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-244312069" status: 204 len: 0 microversion: 2.20 time: 0.026407 Jun 17 13:28:38.364091 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2000/4094] 10.222.0.87 () {60 vars in 1258 bytes} [Fri Jun 17 13:28:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-244312069 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 13:28:39.125450 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:39.125941 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:39.132161 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.132597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.133597 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.134238 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.149318 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] HTTP exception thrown: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Request method failure captured: Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a HTTP/1.1 Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjlH4qw7eZHdMiPVaIeNbWwEME0d5X7w0zJ2BIAPVTHOm4uBpKYteGHJQgCMXBhuDNNDBn3yFqubMXH7Y9D0HHg_nm9DJiTriCt-Q0gI3MYrZSxVl91N23DkagPjfMUCJ8DpVW5qxuKPcQJX5iqp4ajiR9YzU_866TsArhC_Mv3nmQ Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:39.150885 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ead9b99d062e49a88a88e8b37a3b3519", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: f3bfb04b34ed4761bb09be7b29d1ec8f Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.152816 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '57e80959-0f5b-4f32-934a-f939416afe0a'} Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:39.154062 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.156015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.157800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Returning 404 to user: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:39.157800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-69ac5fdc-2626-418f-aa9b-a23c366caa52 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "DELETE /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 404 len: 111 microversion: 2.1 time: 0.031646 Jun 17 13:28:39.157800 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2095/4095] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:28:39 2022] DELETE /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:39.161806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:39.162407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] [instance: 57e80959-0f5b-4f32-934a-f939416afe0a] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:39.168862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.169623 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.170499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.171106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.186822 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] HTTP exception thrown: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Request method failure captured: Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a HTTP/1.1 Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjlH4qw7eZHdMiPVaIeNbWwEME0d5X7w0zJ2BIAPVTHOm4uBpKYteGHJQgCMXBhuDNNDBn3yFqubMXH7Y9D0HHg_nm9DJiTriCt-Q0gI3MYrZSxVl91N23DkagPjfMUCJ8DpVW5qxuKPcQJX5iqp4ajiR9YzU_866TsArhC_Mv3nmQ Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:39.188277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ead9b99d062e49a88a88e8b37a3b3519", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ead9b99d062e49a88a88e8b37a3b3519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: ead9b99d062e49a88a88e8b37a3b3519 Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1517194764 Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: f3bfb04b34ed4761bb09be7b29d1ec8f Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeTestJSON-1517194764-project Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.192199 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '57e80959-0f5b-4f32-934a-f939416afe0a'} Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:39.193250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. Jun 17 13:28:39.195198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:39.196815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] Returning 404 to user: Instance 57e80959-0f5b-4f32-934a-f939416afe0a could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:39.196815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-43186a53-30c6-44b1-9ff9-940c42c9e167 tempest-AttachVolumeTestJSON-1517194764 tempest-AttachVolumeTestJSON-1517194764-project] 10.222.0.87 "GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a" status: 404 len: 111 microversion: 2.1 time: 0.032183 Jun 17 13:28:39.196815 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2001/4096] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:39 2022] GET /compute/v2.1/servers/57e80959-0f5b-4f32-934a-f939416afe0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:39.882773 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7c325631-5782-4ceb-acc3-4838c321defc tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Action: 'create', calling method: .version_select at 0x7f45510ed8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1018220528"}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:40.215033 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7c325631-5782-4ceb-acc3-4838c321defc tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.454112 Jun 17 13:28:40.215721 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2096/4097] 10.222.0.87 () {60 vars in 1154 bytes} [Fri Jun 17 13:28:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 455 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 13:28:40.228372 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-728346cb-5f8b-4f7b-8fff-50e5d70f5c68 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e9b8b80>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:40.294086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-728346cb-5f8b-4f7b-8fff-50e5d70f5c68 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5" status: 200 len: 345 microversion: 2.1 time: 0.070164 Jun 17 13:28:40.294959 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2002/4098] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:40 2022] GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:40.372478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:40.373259 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:40.385239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.386406 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.387330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.388022 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.406711 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] HTTP exception thrown: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Request method failure captured: Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 HTTP/1.1 Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjf05qfOUfDNMRubGomHkEtoIw9Y7JHEzMJ54J8Nn9vHn1m1fcsPg6avq1WLjYI_y_-rhFj5xUyUicO-gG6fZqsX-TZ6VXYdQow_e-kM4-8pBUBBnyxgLxMEudwra4nh2D1EhmGuC6lEBIJ8EsjSYCwgFYUhKhnPt7eDwRVKEoEmyo Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:40.408468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b3495f3daaa44dc9b20a08f3e1128bfa", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: a14c1230233e43789087e9239ffb91e2 Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.410432 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': '4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11'} Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:40.411469 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.413208 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.415831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Returning 404 to user: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:40.415831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-373bb2b1-d4f8-49ab-ac8c-39bb9a2e71c2 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 404 len: 111 microversion: 2.20 time: 0.042774 Jun 17 13:28:40.415831 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2097/4099] 10.222.0.87 () {60 vars in 1279 bytes} [Fri Jun 17 13:28:40 2022] DELETE /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:28:40.420866 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:40.421632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:40.429245 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.429771 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.430632 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.431117 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.446682 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] HTTP exception thrown: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Request method failure captured: Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 HTTP/1.1 Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirHjf05qfOUfDNMRubGomHkEtoIw9Y7JHEzMJ54J8Nn9vHn1m1fcsPg6avq1WLjYI_y_-rhFj5xUyUicO-gG6fZqsX-TZ6VXYdQow_e-kM4-8pBUBBnyxgLxMEudwra4nh2D1EhmGuC6lEBIJ8EsjSYCwgFYUhKhnPt7eDwRVKEoEmyo Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:40.448667 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b3495f3daaa44dc9b20a08f3e1128bfa", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: a14c1230233e43789087e9239ffb91e2 Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.450666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11'} Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:40.451949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. Jun 17 13:28:40.453772 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:40.455439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Returning 404 to user: Instance 4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:40.455439 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-290eed24-9af5-4f83-95ba-21d5da2ac56f tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11" status: 404 len: 111 microversion: 2.20 time: 0.036378 Jun 17 13:28:40.465598 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2003/4100] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:40 2022] GET /compute/v2.1/servers/4fcd3ebd-3c0d-4bd2-b24c-9176ada5aa11 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:28:41.306280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-af6887ea-9a5c-47f8-b920-e91e0096aa87 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f45531519d0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.364045 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-af6887ea-9a5c-47f8-b920-e91e0096aa87 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5" status: 200 len: 346 microversion: 2.1 time: 0.061571 Jun 17 13:28:41.364928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2098/4101] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:41 2022] GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:41.376752 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-cccaa77b-6613-4e97-9b06-f473e02eac2e tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Action: 'create', calling method: .version_select at 0x7f454e9b8820>, body: {"snapshot": {"volume_id": "e4c4737d-0f39-4b53-8dcf-14a9da51b8a5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1496520509"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:41.534551 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-cccaa77b-6613-4e97-9b06-f473e02eac2e tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.162087 Jun 17 13:28:41.536234 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2004/4102] 10.222.0.87 () {60 vars in 1161 bytes} [Fri Jun 17 13:28:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:41.545848 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0358be9e-104b-4211-99a7-9cc1ec038344 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454ec949d0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.586703 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0358be9e-104b-4211-99a7-9cc1ec038344 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64" status: 200 len: 287 microversion: 2.1 time: 0.044886 Jun 17 13:28:41.587331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2099/4103] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Jun 17 13:28:41 2022] GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:28:41.598419 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-587592c6-d1b3-41dd-8e74-bcf02e92c35c tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e90c430>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.612335 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.614067 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:41.621368 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.621900 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.622988 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.623617 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.635267 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-587592c6-d1b3-41dd-8e74-bcf02e92c35c tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041697 Jun 17 13:28:41.639657 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2005/4104] 10.222.0.87 () {58 vars in 1139 bytes} [Fri Jun 17 13:28:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:41.639806 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] HTTP exception thrown: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Request method failure captured: Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: DELETE /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 HTTP/1.1 Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjf05qfOUfDNMRubGomHkEtoIw9Y7JHEzMJ54J8Nn9vHn1m1fcsPg6avq1WLjYI_y_-rhFj5xUyUicO-gG6fZqsX-TZ6VXYdQow_e-kM4-8pBUBBnyxgLxMEudwra4nh2D1EhmGuC6lEBIJ8EsjSYCwgFYUhKhnPt7eDwRVKEoEmyo Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:41.645362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b3495f3daaa44dc9b20a08f3e1128bfa", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: a14c1230233e43789087e9239ffb91e2 Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.647383 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'a700d72f-235d-44b5-a1e5-45ba058ebc43'} Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:41.648434 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.650121 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.651854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Returning 404 to user: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:41.651854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0fb5b9f5-c0b1-48c2-8d39-986c33288216 tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 404 len: 111 microversion: 2.20 time: 0.039658 Jun 17 13:28:41.651854 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2100/4105] 10.222.0.87 () {60 vars in 1279 bytes} [Fri Jun 17 13:28:41 2022] DELETE /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:28:41.652162 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-27f06791-09db-47b3-b777-9ea4261423a9 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e90c0d0>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.663993 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.664691 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] [instance: a700d72f-235d-44b5-a1e5-45ba058ebc43] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:41.672163 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.672897 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.673874 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.674675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.691275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-27f06791-09db-47b3-b777-9ea4261423a9 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64" status: 200 len: 287 microversion: 2.1 time: 0.046876 Jun 17 13:28:41.693060 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2006/4106] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Jun 17 13:28:41 2022] GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:41.698952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] HTTP exception thrown: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Request method failure captured: Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 HTTP/1.1 Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirHjf05qfOUfDNMRubGomHkEtoIw9Y7JHEzMJ54J8Nn9vHn1m1fcsPg6avq1WLjYI_y_-rhFj5xUyUicO-gG6fZqsX-TZ6VXYdQow_e-kM4-8pBUBBnyxgLxMEudwra4nh2D1EhmGuC6lEBIJ8EsjSYCwgFYUhKhnPt7eDwRVKEoEmyo Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:41.700675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b3495f3daaa44dc9b20a08f3e1128bfa", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b3495f3daaa44dc9b20a08f3e1128bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: b3495f3daaa44dc9b20a08f3e1128bfa Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1080417380 Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: a14c1230233e43789087e9239ffb91e2 Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1080417380-project Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: > Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.702638 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'a700d72f-235d-44b5-a1e5-45ba058ebc43'} Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:41.707199 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. Jun 17 13:28:41.709108 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:41.710766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] Returning 404 to user: Instance a700d72f-235d-44b5-a1e5-45ba058ebc43 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:41.710766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e93731aa-848b-4a9c-96e2-7be97352bd4b tempest-AttachVolumeShelveTestJSON-1080417380 tempest-AttachVolumeShelveTestJSON-1080417380-project] 10.222.0.87 "GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43" status: 404 len: 111 microversion: 2.20 time: 0.049189 Jun 17 13:28:41.710766 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2101/4107] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:41 2022] GET /compute/v2.1/servers/a700d72f-235d-44b5-a1e5-45ba058ebc43 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:28:42.704829 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f6c3452f-119d-4425-9652-985aee5aa08a tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e9b8ee0>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:42.745086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f6c3452f-119d-4425-9652-985aee5aa08a tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64" status: 200 len: 287 microversion: 2.1 time: 0.044884 Jun 17 13:28:42.745883 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2007/4108] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Jun 17 13:28:42 2022] GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:43.759665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-84f8661e-fd3e-41b1-91e7-aebc51906b13 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e88c3a0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:43.793471 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-84f8661e-fd3e-41b1-91e7-aebc51906b13 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64" status: 200 len: 288 microversion: 2.1 time: 0.037943 Jun 17 13:28:43.794907 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2102/4109] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Jun 17 13:28:43 2022] GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:43.807723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-10db4a6c-908e-4daa-9a47-936905a2e50f tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e9b88b0>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:43.894989 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-10db4a6c-908e-4daa-9a47-936905a2e50f tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "DELETE /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64" status: 202 len: 0 microversion: 2.1 time: 0.093309 Jun 17 13:28:43.895775 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2008/4110] 10.222.0.87 () {58 vars in 1253 bytes} [Fri Jun 17 13:28:43 2022] DELETE /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:43.905394 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-c95c2c86-80b2-47ef-9fd7-5b1a9614fa56 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454ec41940>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:43.938139 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-c95c2c86-80b2-47ef-9fd7-5b1a9614fa56 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64" status: 200 len: 287 microversion: 2.1 time: 0.037044 Jun 17 13:28:43.939407 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2103/4111] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Jun 17 13:28:43 2022] GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:28:44.951227 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c484cb4e-f33e-4dc8-9289-4ab6f6922fd8 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e9b89d0>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:44.983677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-c484cb4e-f33e-4dc8-9289-4ab6f6922fd8 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] HTTP exception thrown: Snapshot 4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 could not be found. Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c484cb4e-f33e-4dc8-9289-4ab6f6922fd8 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Request method failure captured: Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 HTTP/1.1 Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIGHh1NdPzqQuzAphgjR7rfIF_NqWObzsks3IDjXP7c2FU6tll2FRChNmJeIVNef9L5ZZtevKC3usfsT8eoa4xjaY8JIQakbEqLQCIfG3f4_EJ8WDcnI5dQn0Yi2OxCkR4qXa2he0VyF2i-ckRhKpGUVpEygkrt7ChFL84kZi-6aunQ Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:44.986350 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e9d05e280ff24ba8b2ae4f0bc0161e80", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 21cba6c38f174886b175f5239d18a25d Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Snapshot 4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 could not be found. Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64'} Jun 17 13:28:44.988037 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 could not be found. (HTTP 404) (Request-ID: req-54f8ac09-f21e-4103-9264-8810de0bfab2) Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:44.989072 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:44.990539 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 could not be found. Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 13:28:44.993289 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 could not be found. Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 could not be found. Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c484cb4e-f33e-4dc8-9289-4ab6f6922fd8 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Returning 404 to user: Snapshot 4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:44.996648 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c484cb4e-f33e-4dc8-9289-4ab6f6922fd8 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64" status: 404 len: 111 microversion: 2.1 time: 0.041325 Jun 17 13:28:45.003949 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2009/4112] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Jun 17 13:28:44 2022] GET /compute/v2.1/os-snapshots/4fd7e066-e5f6-4cb8-9813-2c04bd5a9c64 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:45.005257 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-7ffcd186-88fa-4b0b-951f-2b42fa08fb52 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e8d93a0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:45.114183 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-7ffcd186-88fa-4b0b-951f-2b42fa08fb52 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5" status: 202 len: 0 microversion: 2.1 time: 0.114525 Jun 17 13:28:45.115191 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2104/4113] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:28:44 2022] DELETE /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:45.128611 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4c52c323-c94a-41de-be61-33aa8aa8858f tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e9b1550>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:45.196685 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4c52c323-c94a-41de-be61-33aa8aa8858f tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5" status: 200 len: 345 microversion: 2.1 time: 0.071958 Jun 17 13:28:45.197767 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2010/4114] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:45 2022] GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:46.209821 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-296dad2d-a331-46d1-9287-e8e4a6c76c77 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f45510edaf0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:46.241079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-296dad2d-a331-46d1-9287-e8e4a6c76c77 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] HTTP exception thrown: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-296dad2d-a331-46d1-9287-e8e4a6c76c77 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Request method failure captured: Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 HTTP/1.1 Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirIGHh1NdPzqQuzAphgjR7rfIF_NqWObzsks3IDjXP7c2FU6tll2FRChNmJeIVNef9L5ZZtevKC3usfsT8eoa4xjaY8JIQakbEqLQCIfG3f4_EJ8WDcnI5dQn0Yi2OxCkR4qXa2he0VyF2i-ckRhKpGUVpEygkrt7ChFL84kZi-6aunQ Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:46.243050 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e9d05e280ff24ba8b2ae4f0bc0161e80", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 21cba6c38f174886b175f5239d18a25d Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'e4c4737d-0f39-4b53-8dcf-14a9da51b8a5'} Jun 17 13:28:46.245001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. (HTTP 404) (Request-ID: req-1bc67671-4b96-458d-b262-bfad6de3fd12) Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.246130 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:46.248078 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 13:28:46.250019 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-296dad2d-a331-46d1-9287-e8e4a6c76c77 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Returning 404 to user: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:46.251695 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-296dad2d-a331-46d1-9287-e8e4a6c76c77 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5" status: 404 len: 109 microversion: 2.1 time: 0.039725 Jun 17 13:28:46.254983 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3aa5b67-5d49-42f1-a36f-92be6ce9f6e1 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454e90cc10>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:46.257423 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2105/4115] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:46 2022] GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:46.287172 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-f3aa5b67-5d49-42f1-a36f-92be6ce9f6e1 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] HTTP exception thrown: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3aa5b67-5d49-42f1-a36f-92be6ce9f6e1 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Request method failure captured: Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 HTTP/1.1 Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIGHh1NdPzqQuzAphgjR7rfIF_NqWObzsks3IDjXP7c2FU6tll2FRChNmJeIVNef9L5ZZtevKC3usfsT8eoa4xjaY8JIQakbEqLQCIfG3f4_EJ8WDcnI5dQn0Yi2OxCkR4qXa2he0VyF2i-ckRhKpGUVpEygkrt7ChFL84kZi-6aunQ Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:46.289907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e9d05e280ff24ba8b2ae4f0bc0161e80", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 21cba6c38f174886b175f5239d18a25d Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'e4c4737d-0f39-4b53-8dcf-14a9da51b8a5'} Jun 17 13:28:46.291755 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. (HTTP 404) (Request-ID: req-d7d522d3-4f97-40f0-a6b8-6b5a4f3aa124) Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.292721 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 13:28:46.294571 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 13:28:46.296527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f3aa5b67-5d49-42f1-a36f-92be6ce9f6e1 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Returning 404 to user: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f3aa5b67-5d49-42f1-a36f-92be6ce9f6e1 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5" status: 404 len: 109 microversion: 2.1 time: 0.040240 Jun 17 13:28:46.299683 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2011/4116] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:28:46 2022] DELETE /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:46.305832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c14b906-ac96-4af7-8876-2a314003b1a5 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Calling method '.version_select at 0x7f454ec949d0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:46.349012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.wsgi [None req-5c14b906-ac96-4af7-8876-2a314003b1a5 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] HTTP exception thrown: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c14b906-ac96-4af7-8876-2a314003b1a5 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Request method failure captured: Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: request: GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 HTTP/1.1 Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept: application/json Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Accept-Encoding: identity Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Connection: close Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Length: 0 Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Content-Type: application/json Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Host: 10.222.0.87 Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Openstack-System-Scope: None Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Auth-Token: gAAAAABirIGHh1NdPzqQuzAphgjR7rfIF_NqWObzsks3IDjXP7c2FU6tll2FRChNmJeIVNef9L5ZZtevKC3usfsT8eoa4xjaY8JIQakbEqLQCIfG3f4_EJ8WDcnI5dQn0Yi2OxCkR4qXa2he0VyF2i-ckRhKpGUVpEygkrt7ChFL84kZi-6aunQ Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Id: None Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Domain-Name: None Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Identity-Status: Confirmed Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Is-Admin-Project: True Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Id: default Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Domain-Name: Default Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Role: reader,member Jun 17 13:28:46.351477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Roles: reader,member Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_e9d05e280ff24ba8b2ae4f0bc0161e80", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/e9d05e280ff24ba8b2ae4f0bc0161e80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Id: e9d05e280ff24ba8b2ae4f0bc0161e80 Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-304102828 Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Id: default Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Domain-Name: Default Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Id: 21cba6c38f174886b175f5239d18a25d Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: X-User-Name: tempest-VolumesSnapshotsTestJSON-304102828-project Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: method: Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: exception: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: action_args: {'id': 'e4c4737d-0f39-4b53-8dcf-14a9da51b8a5'} Jun 17 13:28:46.353306 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. (HTTP 404) (Request-ID: req-0b379a08-54e4-467a-89d7-1f5c292c2945) Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.354555 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:46.356975 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 13:28:46.358985 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: ERROR nova.api.openstack.wsgi Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-5c14b906-ac96-4af7-8876-2a314003b1a5 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] Returning 404 to user: Volume e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 could not be found. {{(pid=134352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-5c14b906-ac96-4af7-8876-2a314003b1a5 tempest-VolumesSnapshotsTestJSON-304102828 tempest-VolumesSnapshotsTestJSON-304102828-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5" status: 404 len: 109 microversion: 2.1 time: 0.052230 Jun 17 13:28:46.360673 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2106/4117] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:46 2022] GET /compute/v2.1/os-volumes/e4c4737d-0f39-4b53-8dcf-14a9da51b8a5 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:28:48.438113 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-fb9b31ce-8c4b-44b9-a454-51925833a246 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Action: 'create', calling method: .version_select at 0x7f454ed32040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1395173541", "metadata": {"Type": "work"}}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:28:48.810233 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-fb9b31ce-8c4b-44b9-a454-51925833a246 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.509483 Jun 17 13:28:48.813537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2012/4118] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Jun 17 13:28:48 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 511 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 13:28:48.823149 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-a5816972-cf6b-48e2-b619-6367157a5710 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Calling method '.version_select at 0x7f455068a310>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:48.888244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-a5816972-cf6b-48e2-b619-6367157a5710 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5" status: 200 len: 353 microversion: 2.1 time: 0.069398 Jun 17 13:28:48.889577 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2107/4119] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:48 2022] GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:49.902885 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-a63080ff-8f47-4593-a876-2c47b06fc3ff tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Calling method '.version_select at 0x7f454e9a1820>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:49.958150 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-a63080ff-8f47-4593-a876-2c47b06fc3ff tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5" status: 200 len: 354 microversion: 2.1 time: 0.059718 Jun 17 13:28:49.959351 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2013/4120] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:49 2022] GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:28:49.972212 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ea4a41e7-9ba0-4f97-bc73-7b0967621351 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Calling method '.version_select at 0x7f454e8d94c0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:50.032928 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ea4a41e7-9ba0-4f97-bc73-7b0967621351 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5" status: 200 len: 354 microversion: 2.1 time: 0.065852 Jun 17 13:28:50.035410 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2108/4121] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:49 2022] GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:50.050896 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-dd97adc1-4d81-41af-bf98-b06588ad29c2 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Calling method '.version_select at 0x7f454eb48ca0>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:50.144379 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-dd97adc1-4d81-41af-bf98-b06588ad29c2 tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5" status: 202 len: 0 microversion: 2.1 time: 0.097671 Jun 17 13:28:50.145000 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2014/4122] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Jun 17 13:28:50 2022] DELETE /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:28:50.156829 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-13f4dc8d-02dd-438c-b3b2-011fef24c42d tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Calling method '.version_select at 0x7f45510ed8b0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:50.214273 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-13f4dc8d-02dd-438c-b3b2-011fef24c42d tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5" status: 200 len: 353 microversion: 2.1 time: 0.064847 Jun 17 13:28:50.215119 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2109/4123] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:50 2022] GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:28:51.228138 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-28683ecd-5cd0-4a2b-8dad-50d42df91ccf tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Calling method '.version_select at 0x7f454eb48f70>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:51.235875 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:51.236761 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:51.262995 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-28683ecd-5cd0-4a2b-8dad-50d42df91ccf tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] HTTP exception thrown: Volume 7107972b-5969-40c9-8b40-bbc99af0cad5 could not be found. Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-28683ecd-5cd0-4a2b-8dad-50d42df91ccf tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Request method failure captured: Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5 HTTP/1.1 Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIGQ91Aixv4UErJcSYs92ktQYr5hp9ti0sSdv1knp6pWxE_QORSuXg-QuArkG9LIxt7gbbUC8ZSer6aPr786xm0qOFiMpUmNmQXbvJUb0ZnzOA_3Rba-YAJ1Byf9uHcZO7OrSH8b2v4rFjaDZEGsqmcf_kTFjnDkVF5CYLtewd4gTI8 Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 8898548a2b15470498e3e58e3aded754 Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-VolumesGetTestJSON-1033591760 Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:28:51.265930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8898548a2b15470498e3e58e3aded754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/8898548a2b15470498e3e58e3aded754"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_8898548a2b15470498e3e58e3aded754", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/8898548a2b15470498e3e58e3aded754"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-VolumesGetTestJSON-1033591760 Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 8898548a2b15470498e3e58e3aded754 Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-VolumesGetTestJSON-1033591760 Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-VolumesGetTestJSON-1033591760-project Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 34d25b4b0dbc4cc59481e9a13b11bf71 Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-VolumesGetTestJSON-1033591760-project Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Volume 7107972b-5969-40c9-8b40-bbc99af0cad5 could not be found. Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': '7107972b-5969-40c9-8b40-bbc99af0cad5'} Jun 17 13:28:51.267841 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7107972b-5969-40c9-8b40-bbc99af0cad5 could not be found. (HTTP 404) (Request-ID: req-92c00780-5c66-4a48-909c-286e5760640c) Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:51.268970 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:28:51.270573 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7107972b-5969-40c9-8b40-bbc99af0cad5 could not be found. Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 13:28:51.272264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7107972b-5969-40c9-8b40-bbc99af0cad5 could not be found. Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7107972b-5969-40c9-8b40-bbc99af0cad5 could not be found. Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-28683ecd-5cd0-4a2b-8dad-50d42df91ccf tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] Returning 404 to user: Volume 7107972b-5969-40c9-8b40-bbc99af0cad5 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-28683ecd-5cd0-4a2b-8dad-50d42df91ccf tempest-VolumesGetTestJSON-1033591760 tempest-VolumesGetTestJSON-1033591760-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5" status: 404 len: 109 microversion: 2.1 time: 0.046465 Jun 17 13:28:51.273869 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2015/4124] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Jun 17 13:28:51 2022] GET /compute/v2.1/os-volumes/7107972b-5969-40c9-8b40-bbc99af0cad5 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:29:54.627338 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:54.628147 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:54.633153 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8fc0e6c2-5750-4058-b093-d96a204257dc tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Action: 'create', calling method: .version_select at 0x7f454ea71af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1154846485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa1YkY/Zypki6POxs6cXzOWyaDi6QFGUgjRrnuxBfS8fPMqqMRqYSkGeu5jvKI8Lp8YiVRWpb/TzOdDgSdCW+6yp/ls1mQUv6Tieq7DO4od4oPLzp3KWCEHixBT3vktww=="}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:29:54.650460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-8fc0e6c2-5750-4058-b093-d96a204257dc tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Getting quotas for project 362880716d884b098bab99cfcb5ed2aa. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:29:54.654528 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.quota [None req-8fc0e6c2-5750-4058-b093-d96a204257dc tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Getting quotas for user 7e360d7c3b634c9eb26f1068b22ea56b and project 362880716d884b098bab99cfcb5ed2aa. Resources: {'key_pairs'} {{(pid=134352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:29:54.677665 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8fc0e6c2-5750-4058-b093-d96a204257dc tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052311 Jun 17 13:29:54.678399 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2110/4125] 10.222.0.87 () {60 vars in 1158 bytes} [Fri Jun 17 13:29:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:29:54.782897 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-849050947", "imageRef": "610446d6-eac5-434c-a3a5-932fe31fbef9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1154846485", "networks": [{"uuid": "1b4645c7-0d4c-495a-ac15-e2c66887a05f"}]}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:29:55.002486 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.network.neutron [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] validate_networks() for [('1b4645c7-0d4c-495a-ac15-e2c66887a05f', None, None, None, None, None)] {{(pid=134351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:29:55.392687 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Flavor limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:29:55.393133 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Image limits 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:29:55.393604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Flavor pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:29:55.394036 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Image pref 0:0:0 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:29:55.394438 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.virt.hardware [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:29:55.404100 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.404568 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.405324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.405744 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.422930 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Getting quotas for project 362880716d884b098bab99cfcb5ed2aa. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:29:55.427404 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.quota [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Getting quotas for user 7e360d7c3b634c9eb26f1068b22ea56b and project 362880716d884b098bab99cfcb5ed2aa. Resources: {'instances', 'ram', 'cores'} {{(pid=134351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:29:55.443481 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Going to run 1 instances... {{(pid=134351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:29:55.446078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='610446d6-eac5-434c-a3a5-932fe31fbef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:29:55.498537 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-0d8b4f7c-792f-47c7-928f-d8fd3e50b851 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721195 Jun 17 13:29:55.499188 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2016/4126] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Jun 17 13:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:29:55.509252 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-72463779-e359-4af3-b426-725516c35de6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:55.509869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-72463779-e359-4af3-b426-725516c35de6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:55.567279 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-72463779-e359-4af3-b426-725516c35de6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:55.577370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-72463779-e359-4af3-b426-725516c35de6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1258 microversion: 2.1 time: 0.071977 Jun 17 13:29:55.578173 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2111/4127] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:55 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:56.604691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8519fe0c-f1a2-4777-a056-55c9194e143e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:56.605310 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8519fe0c-f1a2-4777-a056-55c9194e143e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:56.671062 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8519fe0c-f1a2-4777-a056-55c9194e143e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:56.678534 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8519fe0c-f1a2-4777-a056-55c9194e143e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1258 microversion: 2.1 time: 0.086926 Jun 17 13:29:56.679106 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2017/4128] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:56 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:57.695686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-0f7a0665-9cb5-47d8-aae8-d5136e2e6723 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:57.696415 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-0f7a0665-9cb5-47d8-aae8-d5136e2e6723 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:57.755456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-0f7a0665-9cb5-47d8-aae8-d5136e2e6723 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:57.762672 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-0f7a0665-9cb5-47d8-aae8-d5136e2e6723 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1258 microversion: 2.1 time: 0.070934 Jun 17 13:29:57.763299 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2112/4129] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:57 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:58.780315 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-e6ad483c-61cf-4669-baaa-942585fe6928 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:58.780974 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-e6ad483c-61cf-4669-baaa-942585fe6928 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:58.837125 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-e6ad483c-61cf-4669-baaa-942585fe6928 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:58.844812 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-e6ad483c-61cf-4669-baaa-942585fe6928 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1258 microversion: 2.1 time: 0.068658 Jun 17 13:29:58.845407 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2018/4130] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:58 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:59.863261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:59.863896 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:59.871336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.871875 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:59.872631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.873057 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:59.936275 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:59.944579 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-04726506-b416-4bcf-875d-f443238aeef5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1262 microversion: 2.1 time: 0.085457 Jun 17 13:29:59.944935 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2113/4131] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:59 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:00.963043 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:00.963768 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:00.971988 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:00.972527 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:00.973410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:00.973907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:01.052058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:01.061753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-af4e524d-d06d-4ae7-bf48-8c44bfcedd48 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1316 microversion: 2.1 time: 0.103579 Jun 17 13:30:01.063024 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2019/4132] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:00 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:02.079962 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:02.080572 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:02.087402 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.087892 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.088655 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.089090 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.234003 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:02.241659 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-8e08d7ec-7254-4ff7-b88e-55add4212d2c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.165920 Jun 17 13:30:02.242542 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2114/4133] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:02 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:03.259944 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:03.260660 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:03.268224 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.268666 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.269416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.269881 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.408499 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:03.416832 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8a873516-7989-415b-b692-6f5ce292b9df tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.161054 Jun 17 13:30:03.417416 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2020/4134] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:03 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:04.434733 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:04.435330 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:04.442518 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.442991 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.443770 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.444196 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.589260 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:04.599200 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-1c85028b-06b3-4c00-b4ed-a63a7cbc5e27 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.168207 Jun 17 13:30:04.600464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2115/4135] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:04 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:05.616574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:05.617190 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:05.619541 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:05.625642 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.626118 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:05.626877 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.627305 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:05.765998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:05.773543 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2ad91cb3-45c4-4a0d-87c0-7b853187c1c7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.160869 Jun 17 13:30:05.774112 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2021/4136] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:05 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:06.790511 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:06.791207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:06.799473 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:06.799921 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:06.800700 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:06.801128 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:06.945569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:06.958458 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-10925a6b-3b6c-46e4-a116-bc2d0bbedbd7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.171814 Jun 17 13:30:06.959521 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2116/4137] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:06 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:30:07.977781 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:07.978588 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:07.986152 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.986726 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:07.987586 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.988171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:08.133526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:08.143819 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7e69c6c0-982e-4776-8941-c4547781883e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.170207 Jun 17 13:30:08.144491 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2022/4138] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:07 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:09.161863 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:09.162456 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:09.164509 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell0:SELECT=8 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:09.170692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.171138 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.171931 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.172362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.306362 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:09.314677 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-67250ca3-3640-4dd9-aba1-b8f567f5b840 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.156759 Jun 17 13:30:09.315216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2117/4139] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:09 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:10.332461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:10.333086 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:10.335908 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=10 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:10.342798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.345058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:10.345058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.345058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:10.481799 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:10.490437 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-806196e8-11e1-441c-bca2-a610b9308c2d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.162022 Jun 17 13:30:10.491019 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2023/4140] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:10 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:11.005813 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-cc88c3ca-d306-429d-bd10-571b147513aa req-5acfd202-a44c-451e-ac0d-4700da4c67a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4caeb41-d082-4aec-975e-8ecd39172604", "tag": "11d8d31c-e795-4cab-b09e-1e77244af248"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:11.015938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-cc88c3ca-d306-429d-bd10-571b147513aa req-5acfd202-a44c-451e-ac0d-4700da4c67a7 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:11.016373 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-cc88c3ca-d306-429d-bd10-571b147513aa req-5acfd202-a44c-451e-ac0d-4700da4c67a7 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:11.028645 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-cc88c3ca-d306-429d-bd10-571b147513aa req-5acfd202-a44c-451e-ac0d-4700da4c67a7 service nova] Creating event network-changed:11d8d31c-e795-4cab-b09e-1e77244af248 for instance f4caeb41-d082-4aec-975e-8ecd39172604 on hv-cinder-84617 Jun 17 13:30:11.034744 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-cc88c3ca-d306-429d-bd10-571b147513aa req-5acfd202-a44c-451e-ac0d-4700da4c67a7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181665 Jun 17 13:30:11.035911 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2118/4141] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:30:11.508677 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:11.509311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:11.516704 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:11.517142 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:11.517895 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:11.518318 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:11.672927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:11.680847 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-9caa6f22-ad4d-4cc6-b741-4e33f8a5f5f5 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.176561 Jun 17 13:30:11.681449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2024/4142] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:11 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:12.699541 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:12.700283 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:12.707220 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.707692 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:12.708460 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.708893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:12.844644 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:12.852584 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e7a5d429-60e5-46b6-8898-a14af6626cf0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.158032 Jun 17 13:30:12.853124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2119/4143] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:12 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:13.870328 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:13.870914 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:13.878278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:13.878719 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:13.879526 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:13.879961 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:14.019279 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:14.027679 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4a8c82ca-4c58-4087-882a-bbebe5b3b5f0 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.161189 Jun 17 13:30:14.033263 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2025/4144] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:13 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:15.045278 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:15.046353 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:15.053464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.053994 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.054869 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.055356 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.326636 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-52db2ae6-a0fb-47c4-8f89-72eed5d1ab33 req-19aa9390-17f6-4f45-9396-615e3e838966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4caeb41-d082-4aec-975e-8ecd39172604", "name": "network-vif-plugged", "status": "completed", "tag": "11d8d31c-e795-4cab-b09e-1e77244af248"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:15.335637 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-52db2ae6-a0fb-47c4-8f89-72eed5d1ab33 req-19aa9390-17f6-4f45-9396-615e3e838966 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.336189 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-52db2ae6-a0fb-47c4-8f89-72eed5d1ab33 req-19aa9390-17f6-4f45-9396-615e3e838966 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.348807 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-52db2ae6-a0fb-47c4-8f89-72eed5d1ab33 req-19aa9390-17f6-4f45-9396-615e3e838966 service nova] Creating event network-vif-plugged:11d8d31c-e795-4cab-b09e-1e77244af248 for instance f4caeb41-d082-4aec-975e-8ecd39172604 on hv-cinder-84617 Jun 17 13:30:15.353956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-52db2ae6-a0fb-47c4-8f89-72eed5d1ab33 req-19aa9390-17f6-4f45-9396-615e3e838966 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100506 Jun 17 13:30:15.354652 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2026/4145] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:15.487558 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:15.495345 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-906a6f90-6678-4dc0-ba34-53ca2a3280ab tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1358 microversion: 2.1 time: 0.453934 Jun 17 13:30:15.495938 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2120/4146] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:15 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1358 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:16.514023 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:16.514833 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:16.521714 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.522278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.523103 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.523572 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.661275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.669601 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-f1869316-8e59-4df4-9576-19561be67605 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1549 microversion: 2.1 time: 0.160298 Jun 17 13:30:16.670193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2027/4147] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:16 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:16.686628 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:16.687244 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:16.694570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.695015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.695843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.696249 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.829952 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.837922 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ffef5e45-8a04-4068-9af9-de37d99e6531 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1549 microversion: 2.1 time: 0.155361 Jun 17 13:30:16.838525 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2121/4148] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:16 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:16.854311 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:16.859464 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.860457 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Searching by: {'deleted': False, 'project_id': '362880716d884b098bab99cfcb5ed2aa'} {{(pid=134351) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 13:30:16.867692 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.868476 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.869264 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.869720 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.961927 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.multi_cell_list [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 13:30:17.055343 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-470cec79-f506-45a5-a680-e74df24d5570 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204816 Jun 17 13:30:17.055937 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2028/4149] 10.222.0.87 () {58 vars in 1124 bytes} [Fri Jun 17 13:30:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:17.066647 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:17.067248 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:17.073502 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:17.073948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:17.074718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:17.075141 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:17.218454 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:17.226444 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-18751396-f149-4c58-a204-056bde14ce81 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1549 microversion: 2.1 time: 0.163665 Jun 17 13:30:17.227031 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2122/4150] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:17 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:18.756858 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c13f864b-1df3-4edb-89ff-c0bf2024c90a tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b5b876c-e796-41d3-a7de-b8a247d18360"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:18.757893 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c13f864b-1df3-4edb-89ff-c0bf2024c90a tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:18.765040 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13f864b-1df3-4edb-89ff-c0bf2024c90a tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:18.765482 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13f864b-1df3-4edb-89ff-c0bf2024c90a tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:18.766239 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13f864b-1df3-4edb-89ff-c0bf2024c90a tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:18.766671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c13f864b-1df3-4edb-89ff-c0bf2024c90a tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:19.014609 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c13f864b-1df3-4edb-89ff-c0bf2024c90a tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261661 Jun 17 13:30:19.015709 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2029/4151] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Jun 17 13:30:18 2022] POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:26.587631 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:26.588241 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:26.590543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:26.596646 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.597089 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.597857 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.598286 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.601675 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=57 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:26.736834 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:26.745516 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b98169e2-402a-444d-b246-e67675952b98 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1595 microversion: 2.1 time: 0.161930 Jun 17 13:30:26.746079 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2123/4152] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:26 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:28.802394 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell0:SELECT=2 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:28.804226 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:28.869193 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-c22cb62d-8bb0-45e9-954f-6f7f242f9cf8 req-6ec120bb-2974-4b40-adf5-f5eb61f1c53f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4caeb41-d082-4aec-975e-8ecd39172604", "tag": "11d8d31c-e795-4cab-b09e-1e77244af248"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:28.878090 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c22cb62d-8bb0-45e9-954f-6f7f242f9cf8 req-6ec120bb-2974-4b40-adf5-f5eb61f1c53f service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:28.878462 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c22cb62d-8bb0-45e9-954f-6f7f242f9cf8 req-6ec120bb-2974-4b40-adf5-f5eb61f1c53f service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:28.882655 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:28.894806 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-c22cb62d-8bb0-45e9-954f-6f7f242f9cf8 req-6ec120bb-2974-4b40-adf5-f5eb61f1c53f service nova] Creating event network-changed:11d8d31c-e795-4cab-b09e-1e77244af248 for instance f4caeb41-d082-4aec-975e-8ecd39172604 on hv-cinder-84617 Jun 17 13:30:28.900423 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-c22cb62d-8bb0-45e9-954f-6f7f242f9cf8 req-6ec120bb-2974-4b40-adf5-f5eb61f1c53f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099319 Jun 17 13:30:28.901250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2030/4153] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:30.132206 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1141504034"}} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:30.132762 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:30.139807 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:30.140264 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.141042 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:30.141467 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.273364 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.network.security_group_api [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Adding security group d0ff81eb-ef17-4ea7-8bef-d0f962cd292b to port 11d8d31c-e795-4cab-b09e-1e77244af248 Jun 17 13:30:30.638372 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e7283472-c66e-422b-b6c9-c2d52c380fc2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/action" status: 202 len: 0 microversion: 2.1 time: 0.509656 Jun 17 13:30:30.639718 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2124/4154] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 13:30:30 2022] POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:30:30.649651 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:30.650342 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:30.654057 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-ebac8eb1-0ae5-4a26-9e0a-d9bcf3cf5bc5 req-5c994da5-7a9b-46e6-bde4-160449f18a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4caeb41-d082-4aec-975e-8ecd39172604", "tag": "11d8d31c-e795-4cab-b09e-1e77244af248"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:30.658209 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:30.659176 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.660786 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:30.661397 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.672808 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-ebac8eb1-0ae5-4a26-9e0a-d9bcf3cf5bc5 req-5c994da5-7a9b-46e6-bde4-160449f18a92 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:30.673550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-ebac8eb1-0ae5-4a26-9e0a-d9bcf3cf5bc5 req-5c994da5-7a9b-46e6-bde4-160449f18a92 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.688561 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-ebac8eb1-0ae5-4a26-9e0a-d9bcf3cf5bc5 req-5c994da5-7a9b-46e6-bde4-160449f18a92 service nova] Creating event network-changed:11d8d31c-e795-4cab-b09e-1e77244af248 for instance f4caeb41-d082-4aec-975e-8ecd39172604 on hv-cinder-84617 Jun 17 13:30:30.694671 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-ebac8eb1-0ae5-4a26-9e0a-d9bcf3cf5bc5 req-5c994da5-7a9b-46e6-bde4-160449f18a92 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049491 Jun 17 13:30:30.695253 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2031/4155] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:30.970395 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:30.979216 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-e3cf2a00-c760-480f-bf67-c33915c2b08c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1761 microversion: 2.1 time: 0.333241 Jun 17 13:30:30.980040 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2125/4156] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:30 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1761 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:53.320246 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=4 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:53.321009 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=3 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:53.325271 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-4afaa381-bc62-4b42-9087-7b60b03361a6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:53.326427 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-4afaa381-bc62-4b42-9087-7b60b03361a6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:53.337461 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4afaa381-bc62-4b42-9087-7b60b03361a6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.337906 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4afaa381-bc62-4b42-9087-7b60b03361a6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:53.338672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4afaa381-bc62-4b42-9087-7b60b03361a6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.339096 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-4afaa381-bc62-4b42-9087-7b60b03361a6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:53.419583 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-4afaa381-bc62-4b42-9087-7b60b03361a6 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/action" status: 202 len: 0 microversion: 2.1 time: 0.100455 Jun 17 13:30:53.420356 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2032/4157] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 13:30:53 2022] POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:30:53.429681 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:53.430478 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:53.433091 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=5 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:53.434012 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=15 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:53.440207 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.440652 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:53.442186 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.442832 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:53.706771 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:53.715735 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-74241d98-fca8-4d14-a27a-fee56fe59fed tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1753 microversion: 2.1 time: 0.290083 Jun 17 13:30:53.716334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2126/4158] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:53 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1753 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:54.733871 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:54.734449 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:54.742109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:54.742587 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:54.743363 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:54.743838 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:54.910136 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:54.919314 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-6df8d00b-26bc-4c63-ac79-865fd3fe3dd2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.190152 Jun 17 13:30:54.919920 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2033/4159] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:54 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:55.938157 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:55.938937 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:55.946679 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:55.947129 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:55.947914 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:55.948370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:56.117949 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:56.128026 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-17b8f501-8cd9-436d-bf24-8708370f928d tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.194098 Jun 17 13:30:56.128629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2127/4160] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:55 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:57.145087 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:57.145753 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:57.152658 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:57.153097 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:57.153824 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:57.154247 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:57.304603 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:57.315739 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-47ed5593-5848-42fc-8c6f-2f72d1240f5e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.174645 Jun 17 13:30:57.316288 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2034/4161] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:57 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:58.337235 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:58.338320 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:58.349398 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:58.350135 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:58.351441 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:58.352202 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:58.517564 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:58.526271 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-b1dd6c36-ae4e-4dbf-8d5b-e7eda81ec012 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.195468 Jun 17 13:30:58.526843 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2128/4162] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:58 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:59.543410 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:59.543998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:59.551078 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:59.551548 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:59.552309 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:59.552740 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:59.701570 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:59.711278 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-31025404-a342-464f-94e9-e728e3f89304 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.171926 Jun 17 13:30:59.711935 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2035/4163] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:59 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:00.734179 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:00.735170 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:00.743468 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:00.743923 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:00.744694 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:00.745124 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:00.906855 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:00.916008 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-dbccc329-73ae-483a-8f44-321ce8419823 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.189248 Jun 17 13:31:00.916553 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2129/4164] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:00 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:01.934695 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:01.935493 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:01.942921 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:01.943434 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:01.944346 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:01.944773 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:02.103137 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:02.114722 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-2abfe7d6-eaf5-4a04-ad8e-ad631da8340e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.184146 Jun 17 13:31:02.115590 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2036/4165] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:01 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:03.133662 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:03.134339 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:03.141243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:03.141683 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:03.142459 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:03.142893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:03.289893 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:03.298162 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-ec8201c0-3434-4978-9c8a-842c490bdf55 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.168454 Jun 17 13:31:03.298740 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2130/4166] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:03 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:04.319324 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:04.320367 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:04.331550 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:04.333275 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:04.334048 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:04.334492 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:04.489924 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:04.498574 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c994bcbb-33a0-47e2-99d2-83fcf1732661 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1758 microversion: 2.1 time: 0.185687 Jun 17 13:31:04.499187 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2037/4167] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:04 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:05.516464 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:05.517063 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:05.524234 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:05.524686 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:05.525463 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:05.525895 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:05.676280 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:05.685103 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-377f9ee6-e259-4329-97be-e5626bfc49a4 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1761 microversion: 2.1 time: 0.172624 Jun 17 13:31:05.685710 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2131/4168] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:05 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:38.138622 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1141504034"}} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:31:38.139503 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:38.141604 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_api:SELECT=12 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:38.142277 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG dbcounter [-] [134351] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:38.148672 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:38.149109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:38.149956 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:38.150653 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:38.299798 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.network.security_group_api [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Removing security group d0ff81eb-ef17-4ea7-8bef-d0f962cd292b from port 11d8d31c-e795-4cab-b09e-1e77244af248 Jun 17 13:31:38.668465 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-c7cab4a1-65b9-4e73-9b6a-a49293f614cd tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/action" status: 202 len: 0 microversion: 2.1 time: 0.534351 Jun 17 13:31:38.670273 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2038/4169] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Jun 17 13:31:38 2022] POST /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:31:38.677331 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [req-6b5d3fc6-d06c-402f-9c3b-d9f8c8f62544 req-59c8ae0c-1c8c-47be-989a-8c85fda64e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4caeb41-d082-4aec-975e-8ecd39172604", "tag": "11d8d31c-e795-4cab-b09e-1e77244af248"}]} {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:31:38.681682 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_api:SELECT=12 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:38.686729 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG dbcounter [-] [134352] Writing DB stats nova_cell1:SELECT=36 {{(pid=134352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:38.696809 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-6b5d3fc6-d06c-402f-9c3b-d9f8c8f62544 req-59c8ae0c-1c8c-47be-989a-8c85fda64e11 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:38.697269 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [req-6b5d3fc6-d06c-402f-9c3b-d9f8c8f62544 req-59c8ae0c-1c8c-47be-989a-8c85fda64e11 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:38.716782 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.compute.server_external_events [req-6b5d3fc6-d06c-402f-9c3b-d9f8c8f62544 req-59c8ae0c-1c8c-47be-989a-8c85fda64e11 service nova] Creating event network-changed:11d8d31c-e795-4cab-b09e-1e77244af248 for instance f4caeb41-d082-4aec-975e-8ecd39172604 on hv-cinder-84617 Jun 17 13:31:38.726568 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [req-6b5d3fc6-d06c-402f-9c3b-d9f8c8f62544 req-59c8ae0c-1c8c-47be-989a-8c85fda64e11 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051285 Jun 17 13:31:38.728043 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2132/4170] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:31:39.780122 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:39.780665 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:39.787220 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:39.787710 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:39.788474 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:39.788903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:39.877769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.objects.instance [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lazy-loading 'services' on Instance uuid f4caeb41-d082-4aec-975e-8ecd39172604 {{(pid=134351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:31:39.960468 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-8039061e-b444-4543-8098-a534dab0c10c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments/1b5b876c-e796-41d3-a7de-b8a247d18360" status: 202 len: 0 microversion: 2.1 time: 0.184764 Jun 17 13:31:39.961248 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2039/4171] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:31:39 2022] DELETE /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments/1b5b876c-e796-41d3-a7de-b8a247d18360 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:31:39.971359 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-d458c25d-fcec-4a29-b678-473d508cea73 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:39.972557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-d458c25d-fcec-4a29-b678-473d508cea73 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:39.979543 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d458c25d-fcec-4a29-b678-473d508cea73 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:39.980477 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d458c25d-fcec-4a29-b678-473d508cea73 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:39.981392 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d458c25d-fcec-4a29-b678-473d508cea73 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:39.981872 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-d458c25d-fcec-4a29-b678-473d508cea73 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:40.020437 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-d458c25d-fcec-4a29-b678-473d508cea73 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053854 Jun 17 13:31:40.021358 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2133/4172] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:31:39 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:31:40.406862 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:31:40.407127 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:31:40.743285 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-c194d264-cc50-4c9b-87e5-cf48d008417e req-8b41c9dd-af5e-465e-b376-cb7d4167dbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4caeb41-d082-4aec-975e-8ecd39172604", "tag": "11d8d31c-e795-4cab-b09e-1e77244af248"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:31:40.753298 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c194d264-cc50-4c9b-87e5-cf48d008417e req-8b41c9dd-af5e-465e-b376-cb7d4167dbf3 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:40.754109 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-c194d264-cc50-4c9b-87e5-cf48d008417e req-8b41c9dd-af5e-465e-b376-cb7d4167dbf3 service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:40.766907 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-c194d264-cc50-4c9b-87e5-cf48d008417e req-8b41c9dd-af5e-465e-b376-cb7d4167dbf3 service nova] Creating event network-changed:11d8d31c-e795-4cab-b09e-1e77244af248 for instance f4caeb41-d082-4aec-975e-8ecd39172604 on hv-cinder-84617 Jun 17 13:31:40.772467 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-c194d264-cc50-4c9b-87e5-cf48d008417e req-8b41c9dd-af5e-465e-b376-cb7d4167dbf3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033085 Jun 17 13:31:40.773045 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2040/4173] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:31:41.033570 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-82879353-45cd-47f2-98e5-5cef03edbae9 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:41.034614 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-82879353-45cd-47f2-98e5-5cef03edbae9 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:41.041243 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82879353-45cd-47f2-98e5-5cef03edbae9 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.041739 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82879353-45cd-47f2-98e5-5cef03edbae9 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.042571 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82879353-45cd-47f2-98e5-5cef03edbae9 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.042953 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-82879353-45cd-47f2-98e5-5cef03edbae9 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.073599 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-82879353-45cd-47f2-98e5-5cef03edbae9 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044334 Jun 17 13:31:41.074177 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2134/4174] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Jun 17 13:31:41 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:31:41.085354 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:41.085903 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:41.092546 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.092998 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.093763 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.094201 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.173749 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] HTTP exception thrown: Instance f4caeb41-d082-4aec-975e-8ecd39172604 is not attached to volume 1b5b876c-e796-41d3-a7de-b8a247d18360 Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Request method failure captured: Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: DELETE /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments/1b5b876c-e796-41d3-a7de-b8a247d18360 HTTP/1.1 Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIHCpLakPigDWhmJpB8EVGFrBoSkBLjyesFNdPIOFTEDdftvFUGFzgebqszmQyOuRG1OIdDkaFTQDJeBmC9mUZDT37_gbOiObdrORy-P-HWnrUFPRDUI_S1gI05G3oRklQi1_4rqQUikAroWPqEKozMOFk-n9zu1PPxEKueIlsO9A1Q Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 362880716d884b098bab99cfcb5ed2aa Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestMinimumBasicScenario-1583546470 Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:31:41.176691 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/362880716d884b098bab99cfcb5ed2aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/362880716d884b098bab99cfcb5ed2aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_362880716d884b098bab99cfcb5ed2aa", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/362880716d884b098bab99cfcb5ed2aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestMinimumBasicScenario-1583546470 Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 362880716d884b098bab99cfcb5ed2aa Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1583546470 Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestMinimumBasicScenario-1583546470-project Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 7e360d7c3b634c9eb26f1068b22ea56b Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestMinimumBasicScenario-1583546470-project Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:31:41.178169 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance f4caeb41-d082-4aec-975e-8ecd39172604 is not attached to volume 1b5b876c-e796-41d3-a7de-b8a247d18360 Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'server_id': 'f4caeb41-d082-4aec-975e-8ecd39172604', 'id': '1b5b876c-e796-41d3-a7de-b8a247d18360'} Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1b5b876c-e796-41d3-a7de-b8a247d18360. Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:31:41.178999 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4caeb41-d082-4aec-975e-8ecd39172604 is not attached to volume 1b5b876c-e796-41d3-a7de-b8a247d18360 Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4caeb41-d082-4aec-975e-8ecd39172604 is not attached to volume 1b5b876c-e796-41d3-a7de-b8a247d18360 Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:41.180321 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Returning 404 to user: Instance f4caeb41-d082-4aec-975e-8ecd39172604 is not attached to volume 1b5b876c-e796-41d3-a7de-b8a247d18360 {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:31:41.181337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-aff2907d-3e34-4599-be66-f8d4b839ccb7 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments/1b5b876c-e796-41d3-a7de-b8a247d18360" status: 404 len: 154 microversion: 2.1 time: 0.097603 Jun 17 13:31:41.181337 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2041/4175] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Jun 17 13:31:41 2022] DELETE /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604/os-volume_attachments/1b5b876c-e796-41d3-a7de-b8a247d18360 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:31:42.327629 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:42.328171 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:42.335066 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.335569 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.336326 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.336756 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.361583 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Going to try to terminate instance {{(pid=134352) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:31:42.442205 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-fc2f70f5-87b9-494c-b6cf-2c50f387125e tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 204 len: 0 microversion: 2.1 time: 0.117915 Jun 17 13:31:42.443015 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2135/4176] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Jun 17 13:31:42 2022] DELETE /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:31:42.452390 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:42.452769 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:42.459654 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.460084 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.460861 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.461295 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.598198 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.policy [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134351) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:42.607059 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-7f11c1e5-b848-47d0-aeaf-65bfe639495c tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1555 microversion: 2.1 time: 0.159149 Jun 17 13:31:42.607673 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2042/4177] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:42 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:43.625649 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:43.626334 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:43.633155 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:43.633594 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:43.634336 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:43.634755 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:43.765748 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:43.773574 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-bd6933d9-9d61-405c-a44e-d66f84c13103 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1555 microversion: 2.1 time: 0.152195 Jun 17 13:31:43.774150 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2136/4178] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:43 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:44.568080 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [req-9e386ee6-aec0-4499-9030-29bafbc0db0d req-0af49019-9b38-46d1-97ca-5655965535dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4caeb41-d082-4aec-975e-8ecd39172604", "name": "network-vif-deleted", "tag": "11d8d31c-e795-4cab-b09e-1e77244af248"}]} {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:31:44.579900 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-9e386ee6-aec0-4499-9030-29bafbc0db0d req-0af49019-9b38-46d1-97ca-5655965535dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.580331 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [req-9e386ee6-aec0-4499-9030-29bafbc0db0d req-0af49019-9b38-46d1-97ca-5655965535dc service nova] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.592723 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.compute.server_external_events [req-9e386ee6-aec0-4499-9030-29bafbc0db0d req-0af49019-9b38-46d1-97ca-5655965535dc service nova] Creating event network-vif-deleted:11d8d31c-e795-4cab-b09e-1e77244af248 for instance f4caeb41-d082-4aec-975e-8ecd39172604 on hv-cinder-84617 Jun 17 13:31:44.599010 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [req-9e386ee6-aec0-4499-9030-29bafbc0db0d req-0af49019-9b38-46d1-97ca-5655965535dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034208 Jun 17 13:31:44.600250 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2043/4179] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Jun 17 13:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:31:44.790535 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:44.791101 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.compute.api [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134352) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:44.798475 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.798913 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.799724 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.800151 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.833120 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.833557 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG oslo_concurrency.lockutils [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.834001 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.objects.instance [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lazy-loading 'fault' on Instance uuid f4caeb41-d082-4aec-975e-8ecd39172604 {{(pid=134352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:31:44.881261 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.policy [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e360d7c3b634c9eb26f1068b22ea56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362880716d884b098bab99cfcb5ed2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134352) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:44.888190 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-754e4c42-81ff-4d36-921e-984bf37c4e97 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 200 len: 1348 microversion: 2.1 time: 0.101571 Jun 17 13:31:44.888932 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2137/4180] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:44 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:45.908219 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '>' {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:45.908925 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.compute.api [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] [instance: f4caeb41-d082-4aec-975e-8ecd39172604] Fetching instance by UUID {{(pid=134351) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:45.916240 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:45.916732 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:45.917501 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:45.917954 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG oslo_concurrency.lockutils [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Lock "e6e78e1e-41cc-4ac6-bcbf-89c37966a7d8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:45.931967 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.wsgi [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] HTTP exception thrown: Instance f4caeb41-d082-4aec-975e-8ecd39172604 could not be found. Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Request method failure captured: Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: request: GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 HTTP/1.1 Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept: application/json Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Accept-Encoding: identity Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Connection: close Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Length: 0 Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Content-Type: application/json Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Host: 10.222.0.87 Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Openstack-System-Scope: None Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: User-Agent: python-urllib3/1.26.9 Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Auth-Token: gAAAAABirIHCpLakPigDWhmJpB8EVGFrBoSkBLjyesFNdPIOFTEDdftvFUGFzgebqszmQyOuRG1OIdDkaFTQDJeBmC9mUZDT37_gbOiObdrORy-P-HWnrUFPRDUI_S1gI05G3oRklQi1_4rqQUikAroWPqEKozMOFk-n9zu1PPxEKueIlsO9A1Q Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Id: None Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Domain-Name: None Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Identity-Status: Confirmed Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Is-Admin-Project: True Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Id: default Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Domain-Name: Default Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Id: 362880716d884b098bab99cfcb5ed2aa Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Project-Name: tempest-TestMinimumBasicScenario-1583546470 Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Role: reader,member Jun 17 13:31:45.933689 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Roles: reader,member Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/362880716d884b098bab99cfcb5ed2aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/362880716d884b098bab99cfcb5ed2aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:8080/v1/AUTH_362880716d884b098bab99cfcb5ed2aa", "adminURL": "http://10.222.0.87:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/362880716d884b098bab99cfcb5ed2aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant: tempest-TestMinimumBasicScenario-1583546470 Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Id: 362880716d884b098bab99cfcb5ed2aa Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1583546470 Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User: tempest-TestMinimumBasicScenario-1583546470-project Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Id: default Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Domain-Name: Default Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Id: 7e360d7c3b634c9eb26f1068b22ea56b Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: X-User-Name: tempest-TestMinimumBasicScenario-1583546470-project Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: method: > Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: exception: Instance f4caeb41-d082-4aec-975e-8ecd39172604 could not be found. Jun 17 13:31:45.934878 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: action_args: {'id': 'f4caeb41-d082-4aec-975e-8ecd39172604'} Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: {{(pid=134351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4caeb41-d082-4aec-975e-8ecd39172604 could not be found. Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:31:45.935594 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4caeb41-d082-4aec-975e-8ecd39172604 could not be found. Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4caeb41-d082-4aec-975e-8ecd39172604 could not be found. Jun 17 13:31:45.936899 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: ERROR nova.api.openstack.wsgi Jun 17 13:31:45.938058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: DEBUG nova.api.openstack.wsgi [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Returning 404 to user: Instance f4caeb41-d082-4aec-975e-8ecd39172604 could not be found. {{(pid=134351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:31:45.938058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO nova.api.openstack.requestlog [None req-220f0856-794a-4cef-a1de-d92ba9f95ca2 tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604" status: 404 len: 111 microversion: 2.1 time: 0.032204 Jun 17 13:31:45.938058 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: [pid: 134351|app: 0|req: 2044/4181] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:45 2022] GET /compute/v2.1/servers/f4caeb41-d082-4aec-975e-8ecd39172604 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:31:45.946948 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: DEBUG nova.api.openstack.wsgi [None req-2ad8c042-cd07-4a1d-b6d5-56107cc5823b tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] Calling method '.version_select at 0x7f454ea2c8b0>' {{(pid=134352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:45.971842 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO nova.api.openstack.requestlog [None req-2ad8c042-cd07-4a1d-b6d5-56107cc5823b tempest-TestMinimumBasicScenario-1583546470 tempest-TestMinimumBasicScenario-1583546470-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1154846485" status: 202 len: 0 microversion: 2.1 time: 0.030622 Jun 17 13:31:45.972425 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: [pid: 134352|app: 0|req: 2138/4182] 10.222.0.87 () {58 vars in 1271 bytes} [Fri Jun 17 13:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1154846485 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:33:35.078370 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:33:35.079239 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:35:00.417415 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:35:00.418070 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:35:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:35:04.083811 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:35:04.084447 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:35:07.345540 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:35:07.346132 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:35:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:36:55.087850 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:36:55.088489 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:36:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:37:00.455171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:37:00.455171 dv-cinder-846172-2-iscsi devstack@n-api.service[134351]: Fri Jun 17 13:37:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:37:11.478608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:37:11.478608 dv-cinder-846172-2-iscsi devstack@n-api.service[134352]: Fri Jun 17 13:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!